Latest News

See All News

Upcoming Events

There are no upcoming events at this time.

Featured Videos

Apache Spark 2.0

Apache Spark 2.0
Structuring Spark: Dataframes, Datasets And Streaming

Structuring Spark: Dataframes, Datasets And Streaming
Large Scale Deep Learning with TensorFlow

Large Scale Deep Learning with TensorFlow
AI: The New Electricity

AI: The New Electricity
Credit Fraud Prevention with Spark and Graph Analysis

Credit Fraud Prevention with Spark and Graph Analysis
See All Videos

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

pyspark.dynamodb.streaming
Add PySpark support for reading AWS DynamoDB streams
@kberbic / created on: November 10, 2019
spark-pipeline-utils
Utility classes to extend and generalize Spark's ML pipeline framework
@tnixon / created on: November 9, 2019
flexible-memoization
A Scala memoization library ready for Spark
@EnzoBnl / created on: November 1, 2019
sparkle
Large-Scale Multi-View Learning in PySpark
@jpdunc23 / created on: October 29, 2019
spark-streaming-jdbc-source
JDBC source for spark structured streaming
@sutugin / created on: October 22, 2019
See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.
Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.
Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

Sign Up Now