SparkHub - A Community Site for Apache Spark

2016 Apache Spark Survey Report

The results are in!

READ THE REPORT

Apache® Spark™ 2.0 now Generally Available

Try it today on Databricks.

Learn More

Structured Streaming in Apache Spark

Watch the demo from Spark Summit East 2017

Learn more

Apache Spark Meetups

Apache Spark is one of the fastest growing Big Data technologies and there are many meetups groups worldwide. Find and join a meetup to learn more about Spark!

Find a Meetup

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

Joseph Torres, Michael Armbrust, Tathagata Das, Shixiong Zhu, Databricks, March 20, 2018

Introducing Stream-Stream Joins in Apache Spark 2.3

Tathagata Das, Joseph Torres, Databricks, March 13, 2018

Announcing Machine Learning Model Export in Databricks

Wayne Chan, Databricks, March 7, 2018

Apache Spark 2.3 with Native Kubernetes Support

Anirudh Ramanathan, Palak Bhatia, Databricks, March 6, 2018

Introducing Apache Spark 2.3

Sameer Agarwal, Xiao Li, Reynold Xin, Jules Damji, Databricks, February 28, 2018

Meltdown and Spectre: Exploits and Mitigation Strategies

Chris Stevens, Nicolas Poggi, Thomas Desrosiers, Reynold Xin, Databricks, January 16, 2018

See All News

Third-party packages that integrate with Apache Spark

sparkTest
i wish I knew what im doing right now
@chamba / created on: April 25, 2018

spark-fits
FITS data source for Spark SQL and DataFrames
@JulienPeloton / created on: April 23, 2018

Smart_Imputation
Smart Imputation. k Nearest Neighbor Imputation methods
@JMailloH / created on: April 10, 2018

SmartReduction
Smart Reduction framework for Big Data
@djgarcia / created on: April 9, 2018

SmartFiltering
Smart Filtering framework for Big Data
@djgarcia / created on: April 9, 2018

2016 Apache Spark Survey Report

Apache® Spark™ 2.0 now Generally Available

Structured Streaming in Apache Spark

Apache Spark Meetups

Latest News

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

Introducing Stream-Stream Joins in Apache Spark 2.3

Announcing Machine Learning Model Export in Databricks

Apache Spark 2.3 with Native Kubernetes Support

Introducing Apache Spark 2.3

Meltdown and Spectre: Exploits and Mitigation Strategies

Upcoming Events

Events Pages Moved to Databricks Events

Featured Videos

New Apache Spark Packages

Apache Spark Resources

Apache Spark Meetups

Updates in your inbox.

Latest News

Upcoming Events

Featured Videos

Apache Spark 2.0

Structuring Spark: Dataframes, Datasets And Streaming

Large Scale Deep Learning with TensorFlow

AI: The New Electricity

Credit Fraud Prevention with Spark and Graph Analysis

New Apache Spark Packages

Apache Spark Resources

Apache Spark Meetups

Updates in your inbox.