SparkHub

A Community Site for Apache Spark

2016 Apache Spark Survey Report

The results are in!

READ THE REPORT

Apache® Spark™ 2.0 now Generally Available

Try it today on Databricks.

Learn More

Structured Streaming in Apache Spark

Watch the demo from Spark Summit East 2017

Learn more

Apache Spark Meetups

Apache Spark is one of the fastest growing Big Data technologies and there are many meetups groups worldwide. Find and join a meetup to learn more about Spark!

Find a Meetup

Latest News

How to Manage Python Dependencies in PySpark

Hyukjin Kwon, Databricks, December 22, 2020

Natively Query Your Delta Lake With Scala, Java, and Python

Denny Lee, Shixiong Zhu, Scott Sandre, Databricks, December 22, 2020

How to Train XGBoost With Spark

Stephen Offer, Databricks, November 16, 2020

Improving the Spark Exclusion Mechanism in Databricks

Tianhan Hu, Xingbo Jiang, Xiao Li, Databricks, November 6, 2020

Faster SQL: Adaptive Query Execution in Databricks

MaryAnn Xue, Allison Wang, Databricks, October 21, 2020

Analyzing Algorand Blockchain Data with Databricks Delta

Anindita Mahapatra, Eric Gieseke, Databricks, October 8, 2020

See All News

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.

Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.

Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

SparkHub is a community site
moderated by

Home
What is Apache Spark?
News
Events
Meetups
Videos
Resources

Download Apache Spark
Apache Spark Documentation
Apache Spark Packages
Spark Summit

Latest News

Featured Videos

Apache Spark 2.0

Structuring Spark: Dataframes, Datasets And Streaming

Large Scale Deep Learning with TensorFlow

AI: The New Electricity

Credit Fraud Prevention with Spark and Graph Analysis

New Apache Spark Packages

Apache Spark Resources

Apache Spark Meetups

Updates in your inbox.