Last week’s Hadoop Summit brought together thought leaders from the Big Data ecosystem around a comprehensive agenda. Hosted by Hortonworks and Yahoo, the event was extremely well organized and it was powerful to see more than 2,100 attendees and 50 sponsors come together, a strong validation of the growing interest in collaborating to help better define the next-generation data platform.
The overarching message for Hadoop Summit 2012 was about bringing communities together to establish a robust Big Data ecosystem for making Hadoop “enterprise ready.” The definition of community is no longer limited to open source; it is inclusive of vendors and end users. In fact, there were several sessions that specifically highlighted the need for robust data platform services and open APIs to enable vendors to integrate with open source software.
In his keynote, Hortonworks VP of Strategy Shaun Connelly mentioned that the Big Data market is estimated at $100 billion in a recent Bank of America Merrill Lynch report, with about $14 billion of that sized for Hadoop. Furthermore, more than half of the world’s data is predicted to be touched or processed by Apache Hadoop by the end of 2015.
Not surprisingly, a major inhibitor for Hadoop adoption continues to be the inability to use existing IT skills. Enterprise adoption will require companies to leverage the investments that they have already made, and IT organizations to be comfortable and confident with the solutions. In this context, Syncsort has a lot to offer with a proven track record across thousands of data integration customers for its high performance, ease of use and low TCO. DMExpress is a great complement to the Big Data solutions stack.
Geoffrey Moore, best-selling author of Crossing the Chasm, was the keynote for the second day of the Hadoop Summit. He highlighted that consumer IT redefines the user experience, creating a disruption with enterprise IT on hold and consumer IT on fire. He described the Big Data business opportunity for companies that can “respect the demands of the enterprise and are fully committed to the user experience.” Companies with a vision to optimize business solutions instead of optimizing technologies will be poised to seize a big share of the Big Data market.
As my colleague Keith Kohl pointed out in his blog post on Hadoop Summit, it was a great week for Syncsort. We are very excited to be part of the Big Data technology adoption curve and what promises to be a game-changing decade!