Aiming to better support machine learning and analytical environments, Pentaho Labs on Tuesday announced that it has developed a native integration for the Python language through Pentaho Data Integration (PDI).
PDI is essentially a portable "data machine" for ETL, which you can deploy as a stand-alone Pentaho cluster or inside a Hadoop cluster through MapReduce or YARN. Will Gorman, vice president of Pentaho Labs at Hitachi subsidiary Pentaho, says the integration means data scientists can now use of the most popular and flexible open-source languages to increase productivity and data governance while supporting predictive analytics and machine learning. He says the integration will also make data science and predictive modeling more accessible to the developer community.
"Python is the environment that is growing the fastest from a community perspective," Gorman says. "And a large portion of teams are working with Python to build out machine learning and analytical environments."
Python wins popularity contest
"As the field of data science continues to grow outside the world of research and statisticians, it is important for our team to arm developers with a wide range of programming languages," Gorman says. "Python provides developers another option for data science with a general purposes language. With these languages, data scientists have the ability to use the most appropriate language with increased use of data preprocessing through PDI."
Gorman also says that Python is the preferred language for deep learning researchers, providing engineers in data science the ability to more easily develop predictive models.
"Python is widely deployed by developers and engineers to create statistical analytic workflows, particularly in areas such as finance, oil and gas and physics," Matt Aslett, research director, 451 Research, said in a statement Tuesday. "We see Python as a primary language for artificial intelligence engines and Pentaho's native integration of Python will allow organizations to apply their deep domain expertise and improve predictive analytics and machine learning algorithms."
PDI for Python is available for download in the Pentaho Marketplace.
Sign up for CIO Asia eNewsletters.