Should I rush to upgrade?
With promised large gains in performance and long-awaited new features in Spark Streaming, it's tempting to hit Upgrade as soon as Apache Spark 2.0 becomes generally available in the next few weeks.
I would temper that impulse with a note or two of caution. A lot has changed under the covers for this release, so expect some bugs to crawl out as people start running their existing code on test clusters.
Nonetheless, with a brace of new features and performance improvements, it's clear that Apache Spark 2.0 deserves its full version bump. Look for it in the next few weeks!
Sign up for CIO Asia eNewsletters.