Big Data investments stay small but risks increase dramatically. Big Data projects will increase dramatically but the monetary investments by brand name vendors will stay small. New, high-cost infrastructures will be prohibitive so organisations will turn to more targeted do-it-yourself project-based investments using open source Hadoop.
The adoption of Hadoop will increase and project-based investments for Big Data will grow. Due to the lack of data management capabilities and built-in resilience, current Big Data solutions have severe limitations. Hadoop is popular due to its analytical power of and use of commodity hardware but it comes with cost and risk. Hadoop also has some availability issues, requires additional administrative overhead and requires triple the amount of storage as other data. This adds to long-term costs and increases server and storage sprawl in the data centre.
In addition, the risks associated with Big Data will significantly increase, especially when it is inefficiently stored and managed. New information governance best practices will arise to help keep data sets from getting too large and burdensome while ensuring data is accessible, protected and properly retained.Defensible deletion and predictive coding become information governance mainstays. Defensible deletion will emerge as the central approach to overcoming the costs and legal risks associated with managing out of control data proliferation. At the same time, predictive coding will become mainstream and overturn traditional thinking that manual, linear document review is the gold standard and meets legal hold requirement.
Industry adopts flash storage, begins to replace tier-one storage. We believe there will be a significant increase in solid state (SSD) and flash storage adoption in 2013 to the point that flash storage will be trialed at nearly every Fortune 1000 enterprise within the year. Flash storage, with its fast accessibility and reliability, will begin to replace tier-one storage in many data centres. These data centres will also look for new ways to maximise storage utilisation on solid state storage to reduce costs of implementing flash storage, which will continue to decline.
In response to the anticipated Big Data trends, one of the single biggest initiatives we see local organisations taking on is information governance - defined as a formal programme that allows organisations to proactively classify, retain and discover information to reduce information risk, reduce the cost of managing information, establish retention policies and streamline their eDiscovery process.
Symantec's 2012 State of the Data Center Survey shows that nine out of 10 (91 percent) of Singapore organisations surveyed are either actively discussing governance or have implemented trials or actual governance programmes. Organisations understand that with an information governance programme in place, they will find it easier to mine data for valuable business insights and enable competitive advantage.
Sign up for CIO Asia eNewsletters.