Apache Beam is an incredibly ambitious project. Its ultimate goal is to unify all the data processing engines under one API -- and make it trivially easy to migrate, say, your Beam application running on a self-hosted Flink cluster over to Google Cloud Dataflow.
As somebody who has to develop these applications, this is great. It's clear that Google has spent years refining the Beam model to cover most of the data processing patterns that many of us will need to implement. Note, however, that Beam is currently an "incubating" Apache project, so you'll want to exercise caution before putting it into production. But it's worth keeping a close eye on Beam as it incorporates more runners -- and ports the Beam SDK to more languages.
Sign up for CIO Asia eNewsletters.