Latest News

See All News

Upcoming Events

There are no upcoming events at this time.

Featured Videos

Apache Spark 2.0

Apache Spark 2.0
Structuring Spark: Dataframes, Datasets And Streaming

Structuring Spark: Dataframes, Datasets And Streaming
Large Scale Deep Learning with TensorFlow

Large Scale Deep Learning with TensorFlow
AI: The New Electricity

AI: The New Electricity
Credit Fraud Prevention with Spark and Graph Analysis

Credit Fraud Prevention with Spark and Graph Analysis
See All Videos

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

spark-dirty-cat
Similarity encoding of dirty categorical variables (strings)
From: @ahoyosid / owner: @rakutentech / created on: November 14, 2018
smote-bd
SMOTE-BD: A distributed Synthetic Minority Oversampling Technique (SMOTE) for Big Data.
@majobasgall / created on: November 7, 2018
sarplus
pronounced sUrplus as it's simply better if not best!
@eisber / created on: October 24, 2018
SparkDensityTree
Adaptive histogram estimation
@TiloWiklund / created on: October 16, 2018
Equal-Width-Discretizer
Equal Width Discretizer
@djgarcia / created on: October 1, 2018
See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.
Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.
Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

Sign Up Now