Subscribe / Unsubscribe Enewsletters | Login | Register

Pencil Banner

Apache Beam wants to be uber-API for big data

Ian Pointer | April 14, 2016
New, useful Apache big data projects seem to arrive daily. Rather than relearn your way every time, what if you could go through a unified API?

Grand ambitions

Apache Beam is an incredibly ambitious project. Its ultimate goal is to unify all the data processing engines under one API -- and make it trivially easy to migrate, say, your Beam application running on a self-hosted Flink cluster over to Google Cloud Dataflow.

As somebody who has to develop these applications, this is great. It's clear that Google has spent years refining the Beam model to cover most of the data processing patterns that many of us will need to implement. Note, however, that Beam is currently an "incubating" Apache project, so you'll want to exercise caution before putting it into production. But it's worth keeping a close eye on Beam as it incorporates more runners -- and ports the Beam SDK to more languages.

Source: Infoworld 


Previous Page  1  2  3 

Sign up for CIO Asia eNewsletters.