Latest News

See All News

Upcoming Events

There are no upcoming events at this time.

Featured Videos

Apache Spark 2.0

Apache Spark 2.0
Structuring Spark: Dataframes, Datasets And Streaming

Structuring Spark: Dataframes, Datasets And Streaming
Large Scale Deep Learning with TensorFlow

Large Scale Deep Learning with TensorFlow
AI: The New Electricity

AI: The New Electricity
Credit Fraud Prevention with Spark and Graph Analysis

Credit Fraud Prevention with Spark and Graph Analysis
See All Videos

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

twut
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
From: @ruebot / owner: @archivesunleashed / created on: December 11, 2019
Imbalanced-Classification-Ensemble
ICE_BD is a Smart Data Preprocessing Ensemble for Imbalanced Big Data Classification
@djgarcia / created on: November 30, 2019
spark-dynamodb-source
DynamoDB source for Spark Structured Streaming
@kolia1985 / created on: November 23, 2019
pyspark.dynamodb.streaming
Add PySpark support for reading AWS DynamoDB streams
@kberbic / created on: November 10, 2019
spark-pipeline-utils
Utility classes to extend and generalize Spark's ML pipeline framework
@tnixon / created on: November 9, 2019
See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.
Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.
Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

Sign Up Now