Latest News

See All News

Featured Videos

Apache Spark 2.0

Apache Spark 2.0
Structuring Spark: Dataframes, Datasets And Streaming

Structuring Spark: Dataframes, Datasets And Streaming
Large Scale Deep Learning with TensorFlow

Large Scale Deep Learning with TensorFlow
AI: The New Electricity

AI: The New Electricity
Credit Fraud Prevention with Spark and Graph Analysis

Credit Fraud Prevention with Spark and Graph Analysis
See All Videos

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

spark-dicom
A library to read dicom file in a spark sql data frame.
@abzoobabd / created on: February 5, 2020
streaminglens
Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
From: @abhishekd0907 / owner: @qubole / created on: February 5, 2020
twut
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
From: @ruebot / owner: @archivesunleashed / created on: December 11, 2019
Imbalanced-Classification-Ensemble
ICE_BD is a Smart Data Preprocessing Ensemble for Imbalanced Big Data Classification
@djgarcia / created on: November 30, 2019
spark-dynamodb-source
DynamoDB source for Spark Structured Streaming
@kolia1985 / created on: November 23, 2019
See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.
Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.
Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

Sign Up Now