Hortonworks Releases Data Platform 2.0 

Hortonworks today announced the general availability of the Hortonworks Data Platform (HDP) 2.0, the first commercial distribution built on the recent Hadoop 2 GA release from the Apache Software Foundation. HDP 2.0 represents the culmination of five years of work across the Hadoop community and delivers the YARN-based architecture of Hadoop 2, phase 2 of the Stinger Initiative and includes the very latest innovations from the broader Hadoop ecosystem in a single integrated and tested platform appropriate for mainstream enterprise use.

With Hadoop 2, Apache Hadoop YARN serves as the Hadoop operating system, and takes Hadoop beyond simply a single-use data platform for batch processing to a multi-use platform that enables batch, interactive, online and stream processing. By acting as the primary resource manager and mediator of access to data stored in HDFS, YARN enables enterprises to store data in a single place and interact with it in multiple ways simultaneously and with consistent levels of service.

The Stinger Initiative was launched at the beginning of 2013 as a broad community-based effort to enhance the speed, scale and breadth of SQL semantics supported by Apache Hive. By including the recently released Hive 0.12 which is the culmination of phase 2 of the Stinger Initiative, HDP 2.0 represents a significant step forward for Hive, the de-facto standard for SQL access in Hadoop today and the only SQL interface designed for queries that scale from gigabytes to petabytes. Microsoft has been a critical partner in the development of HDP 2.0 and has contributed more than 6,000 engineering hours across various Apache projects, as well as porting HDP 2.0 to Windows, which will be available next month.

HDP 2.0 is the first enterprise Hadoop platform to include the latest enterprise features delivered in Hadoop 2 and all the related Apache projects, many of which had significant GA community releases within the last few weeks. The key projects in HDP include:

• Apache Hadoop 2.2.0
• Apache Hive 0.12.0
• Apache HCatalog
• Apache Pig 0.12.0
• Apache HBase 0.96
• Apache Ambari 1.4.1
• Apache ZooKeeper 3.4.5
• Apache Oozie 4.0.0
• Apache Sqoop 1.4.4
• Apache Flume 1.4.0
• Apache Mahout 0.8.0