SAN FRANCISCO and PALO ALTO, Calif., Oct. 29, 2013 /PRNewswire/ -- At the Strata Conference + Hadoop World 2013, Pivotal announced that Spring for Apache Hadoop, which is bundled with Spring XD, has been certified with Pivotal™ HD and Hortonworks HDP products.  This certification enables Java developers to use modern and familiar tools to build big data applications that work across major Hadoop distributions without modification including Apache Hadoop 1.2.1 and 2.0.6 alpha, as well as Pivotal HD 1.0, and Hortonworks HDP 1.3.

Developing comprehensive big data applications can be difficult, as today's open source projects typically use separate, independent projects to integrate everything from stream analysis and batch workflow orchestration to data import and export. This leaves a Java developer to wrestle with many different programming, configuration and extensibility models.

In addition to helping support portability across Hadoop runtime environments, Spring for Apache Hadoop (SHDP) aims to help simplify the development of Hadoop based applications by providing a consistent configuration and API across a wide range of Hadoop ecosystem projects such as Pig, Hive, and Cascading in addition to providing extensions to Spring Batch for orchestrating Hadoop based workflows. 

SHDP, together with Spring Integration, Spring Batch and Spring Data are part of the Spring IO Platform as foundational libraries.  Building on top of, and extending this foundation, the Spring IO platform provides a big data runtime named Spring XD (XD = eXtreme Data).  Spring XD, available in an early milestone release, provides a single platform that comprehensively addresses common use cases in big data solutions – without the need to write code – just by using a domain specific language (DSL).  These use cases include data ingestion from external sources, data transformation and real-time analytics, data import/export to/from HDFS, and workflow orchestration.  

These foundational parts of Spring IO platform make Hadoop development more accessible to a wider range of Java developers - including the massive Spring developer community - and make the process even faster for Hadoop experts. 

"Spring XD connects big data apps to existing systems, as well as any new data source or data store - and will indeed appeal to the enterprise," said Shaun Connolly, vice president, Corporate Strategy for Hortonworks.

"Big Data applications are a critical emerging trend for enterprises to address new opportunities hidden in data at Internet scale," said Adrian Colyer, chief technology officer, Applications at Pivotal.  "This Spring XD advancement works to unlock Big Data in Hadoop using leading distributions - for the masses of enterprise Java developers using Spring."

Spring XD is open source and available at no charge under an Apache 2.0 license, and can be obtained from the Spring.io website.

Resources

• Spring IO Platform
  https://spring.io/platform
• Spring XD Project
  http://projects.spring.io/spring-xd/
• Spring for Apache Hadoop Project
  http://projects.spring.io/spring-hadoop/
• How Spring XD works
  https://github.com/spring-projects/spring-xd/wiki/Architecture
• Source code:
  https://github.com/spring-projects/spring-xd
• Install Spring XD via Homebrew
  brew tap pivotal/tap && brew install sprngxd
• Hortonworks Sandbox: Using Spring XD to stream Tweets to Hadoop for Sentiment Analysis
  https://github.com/hortonworks/hadoop-tutorials/blob/master/Community/T02_Spring_XD_Hadoop_Twitter.md
• Getting Started Guide: Creating a stream of live Twitter data using Spring XD on Mac OS
  https://spring.io/guides/gs/spring-xd-osx/

About Pivotal
Pivotal, committed to open source and open standards, is a leading provider of application and data infrastructure software, agile development services, and data science consulting. Pivotal's revolutionary Enterprise PaaS product, powered by Cloud Foundry, will be available in November 12, 2013. Learn more at http://www.gopivotal.com/theplatform. Follow Pivotal on Twitter @gopivotal and LinkedIn, G+.

About Hortonworks
Hortonworks is the only 100-percent open source software provider to develop, distribute and support an Apache Hadoop platform explicitly architected, built and tested for enterprise-grade deployments. Developed by the original architects, builders and operators of Hadoop, Hortonworks stewards the core and delivers the critical services required by the enterprise to reliably and effectively run Hadoop at scale. Our distribution, Hortonworks Data Platform, provides an open and stable foundation for enterprises and a growing ecosystem to build and deploy big data solutions. Hortonworks also provides unmatched technical support, training and certification programs. For more information, visit www.hortonworks.com. Get started and Go from Zero to Hadoop in 15 Minutes with the Hortonworks' Sandbox.

©2013 GoPivotal, Inc.  All rights reserved.  Pivotal is a trademark or registered trademark of GoPivotal, Inc. in the United States and/or other countries.

This release contains "forward-looking statements" as defined under the Federal Securities Laws.  Actual results could differ materially from those projected in the forward-looking statements as a result of certain risk factors, including but not limited to: (i) adverse changes in general economic or market conditions; (ii) delays or reductions in information technology spending; (iii) the relative and varying rates of product price and component cost declines and the volume and mixture of product and services revenues; (iv) competitive factors, including but not limited to pricing pressures and new product introductions; (v) component and product quality and availability; (vi) fluctuations in VMware, Inc.'s operating results and risks associated with trading of VMware stock; (vii) the transition to new products, the uncertainty of customer acceptance of new product offerings and rapid technological and market change; (viii) risks associated with managing the growth of our business, including risks associated with acquisitions and investments and the challenges and costs of integration, restructuring and achieving anticipated synergies; (ix) the ability to attract and retain highly qualified employees; (x) insufficient, excess or obsolete inventory; (xi) fluctuating currency exchange rates; (xii) threats and other disruptions to our secure data centers or networks; (xiii) our ability to protect our proprietary technology; (xiv) war or acts of terrorism; and (xv) other one-time events and other important factors disclosed previously and from time to time in the filings EMC Corporation, the parent company of Pivotal, with the U.S. Securities and Exchange Commission.  EMC and Pivotal disclaim any obligation to update any such forward-looking statements after the date of this release.

SOURCE Pivotal