Press Release

Pivotal Open Sources Top Analytics Engine and Supercharges Hadoop Ecosystem

Contribution of HAWQ analytics engine and MADlib data science tools is latest example of Pivotal’s commitment to open source technology. Pivotal partners with Hortonworks, Altiscale to realize the promise of big data analytics.




Pivotal continues its commitment to open source technology through the contribution of its Pivotal HAWQ Hadoop-native advanced SQL analytics database and MADlib parallel machine learning library to the Apache Software Foundation.

HAWQ and MADlib deliver major updates in performance, scalability and deep Apache Hadoop integrations.

Hortonworks and Altiscale reaffirm continued partnerships with Pivotal to realize the promise of big data analytics on Hadoop.

San Francisco, September 29, 2015 – Pivotal®, the company accelerating digital transformation and modern application development for enterprises, today announced that it will continue its commitment to advancing open source through its contribution of the HAWQ advanced SQL on Hadoop analytics and MADlib® machine learning technologies to The Apache Software Foundation (ASF). As every organization transforms into a software business, it is imperative they have easy access to the most powerful analytics tools to create new software-driven experiences for people and the world.

Delivering a truly Apache Hadoop®-native analytical database through ASF enables enterprises to harness the power of parallel data processing technology proven in the most demanding, business-critical, high-throughput environments. Apache HAWQ (incubating) offers ANSI SQL compliance, a scale-out massively parallel processing (MPP) architecture, unrivaled performance, state-of-the-art query optimization, multi-tenant awareness, low-latency interactive ad hoc analytical query capabilities, and proven integration with leading business intelligence and visualization tools.

Pivotal HAWQ: A Powerful Analytics Engine for Enterprises

Launched in 2013, and leveraged from over a decade’s worth of intellectual property and expertise developed through the creation of the Pivotal Greenplum® data warehousing system and PostgreSQL, HAWQ has helped define a key enterprise application for Hadoop – advanced SQL analytics. Through these major enhancements and, critically, HAWQ’s contribution to ASF, Pivotal seeks to ensure Hadoop’s place as the cornerstone of advanced data science, business intelligence, and data warehousing.

In addition to HAWQ, Pivotal and the MADlib community are contributing the MADlib machine-learning library for incubation at ASF. Apache MADlib (incubating) is a powerful collection of scale out, parallel machine learning algorithms seamlessly integrated with HAWQ. MADlib was developed by Pivotal, in conjunction with researchers from the University of California, Berkeley, Stanford University, the University of Florida and Pivotal’s customers. It has been used broadly in the finance, automotive, media, telecommunications and transport industries.

Uniquely, Apache HAWQ (incubating) is able to execute these powerful algorithms in parallel and natively inside any Hadoop cluster based on Pivotal’s Hadoop distribution (Pivotal HD), Hortonworks Data Platform (HDP), or the planned ODPi ( core. An open source project for four years, Pivotal and the MADlib community contributed MADlib to ASF in order to simplify governance and improve access by developers and users for further integration and advancement with Apache HAWQ and beyond. Today, MADlib supports HAWQ, Pivotal Greenplum and PostgreSQL, all provided in a licensed and supported enterprise subscription offering from Pivotal as part of Pivotal Big Data Suite.

Pivotal will continue aggressive development of HAWQ and MADlib through ASF (during incubation and following acceptance as a top-level project) and today also reaffirmed continued partnerships with Hortonworks and Altiscale to realize the promise of big data analytics.


Pivotal will continue to distribute and support commercial distributions of Apache HAWQ (incubating) and Apache MADlib (incubating) - via Pivotal Big Data Suite. Customers with enterprise support agreements will also be entitled to request priority technical assistance as well as receive patches and hotfixes.

Supporting Quotes

Gavin Sherry, Vice President and CTO, Data, Pivotal

“We strongly believe our HAWQ and MADlib technologies, as Apache Software Foundation incubation projects, bring unprecedented SQL processing capabilities and know-how to Hadoop developers and users. We’re excited and humbled at the prospect of collaborating closely, in the open, with many of the leading minds in data processing systems today.”

Dr. Konstantin Boudnik, VP Open Source Development, WANDisco

“Having mature, production ready projects like HAWQ joining the Apache Software Foundation shows how the open-source development paradigm changed the landscape of enterprise applications. Apache HAWQ (incubating) is building on an amazing heritage and versatility of PostgreSQL and is well positioned for the high performance expectations of enterprise organizations."

Justin Erenkrantz, Head of Compute Architecture, Bloomberg LP

“We welcome the contribution of HAWQ to The Apache Software Foundation. By providing a scalable SQL engine built upon primitives like YARN, we expect that Apache HAWQ will further expand the Apache Hadoop ecosystem's ability to address today and tomorrow's data warehousing needs.“

Scott Gnau, CTO, Hortonworks

“This further extends the partnership that Hortonworks and Pivotal have in place today around Pivotal HD and the Hortonworks Data Platform. Hortonworks has always strongly supported open source software and the power of the community to advance innovation. We are thrilled to see the contribution of HAWQ to the Apache Software Foundation. Enterprises can use HAWQ, an HDP YARN-ready and certified application, to tap into their existing SQL skills to explore new use cases while accessing a single cluster of data in PHD and HDP.”

Raymie Stata, CEO, Altiscale

“At Altiscale, we firmly believe that Big Data will come to be used throughout the enterprise. The future users of Hadoop-based data will not be limited to data scientists or data engineers, but will also include the data-savvy business professional who is using analytics to execute on front-line business decisions. The critical link between Hadoop and broader business intelligence is the MPP SQL engine. That’s why we are excited to be a cloud provider of HAWQ, which is one of the most mature, robust MPP SQL solutions available.”


“Toshiba is focused on the IoT business of social infrastructure and various industrial fields, where we continuously co-create value with our customers. To meet the needs of social infrastructure's IoT system to process enormous volume of data at high velocity reliably, we develop and provide our own big data software. We opted for an open-source model for our big data software as we believe that IoT system must be built on an open platform in collaboration with our partners. Through ODP, compatibility between our software, Apache Hadoop and other ODP members will be improved, and we believe that this will enable the end-user to build big data system much more quickly and efficiently.”


About Pivotal

Pivotal’s Cloud Native platform drives software innovation for many of the world’s most admired brands. With millions of developers in communities around the world, Pivotal technology touches billions of users every day. After shaping the software development culture of Silicon Valley's most valuable companies for over a decade, today Pivotal leads a global technology movement transforming how the world builds software.


Michael Lee
Media Relations

Rita Manachi
Analyst Relations

©2015 Pivotal Software, Inc. All rights reserved. Pivotal, Pivotal HAWQ, MADlib, and Pivotal Greenplum are trademarks and/or registered trademarks of Pivotal Software, Inc. in the United States and/or other Countries. Apache, Apache Hadoop, and Hadoop are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other Countries.

This release contains statements relating to Pivotal’s expectations, projections, beliefs and prospects which are “forward-looking statements“ about Pivotal’s future which by their nature are uncertain. Such forward-looking statements are not guarantees of future performance, and you are cautioned not to place undue reliance on these forward-looking statements. Actual results could differ materially from those projected in the forward-looking statements as a result of many factors, including but not limited to: (i) adverse changes in general economic or market conditions; (ii) delays or reductions in information technology spending; (iii) risks associated with managing the growth of Pivotal’s business, including operating costs; (iv) changes to Pivotal’s software business model; (v) competitive factors, including pricing pressures and new product introductions; (vi) Pivotal’s customers' ability to transition to new products and computing strategies such as cloud computing, the uncertainty of customer acceptance of emerging technologies, and rapid technological and market changes; (vii) Pivotal's ability to protect its proprietary technology; (viii) Pivotal’s ability to attract and retain highly qualified employees; (ix) Pivotal’s ability to execute on its plans and strategy; and (x) risks related to data and information security vulnerabilities. All information set forth in this release is current as of the date of this release. These forward-looking statements are based on current expectations and are subject to uncertainties and changes in condition, significance, value and effect as well as other risks disclosed previously and from time to time in documents filed by EMC Corporation, the parent company of Pivotal, with the U.S. Securities and Exchange Commission. EMC and Pivotal assume no obligation to, and do not currently intend to, update any such forward-looking statements after the date of this release.