Huawei announced that the Spark SQL on HBase package is now open source and available. Dubbed Astro, the end-to-end package combines the capabilities of Spark, Spark SQL and HBase, helps drive Spark adoption in broad a NoSQL customer base and provides powerful online query and analytics capabilities for large scale data processing in vertical enterprises.
Apache® Spark™ News
Huawei Bears Open Source Gifts From China
Chinese technology giant Huawei has frequently been the subject of suspicion and sanction, particularly in the United States. But it’s also a company that produces key pieces of technology infrastructure, and an active contributor to various international open source initiatives. This week, at OSCON in Portland, Huawei announced the release of a new open source project, Astro. Astro tightly integrates the database capabilities of Apache HBase with the online query and analytics power of Apache Spark, potentially bringing Spark-powered data science a step closer to the huge structured data stores locked up inside many global enterprises.
Feature Engineering at Scale With Spark
At Collective we are in programmatic advertisement business, it means that all our advertisement decisions (what ad to show, to whom and at what time) are driven by models. We do a lot of machine learning, build thousands predictive models and use them to make millions decision per second.