Latest News

See All News

Upcoming Events

There are no upcoming events at this time.

Featured Videos

Apache Spark 2.0

Apache Spark 2.0
Structuring Spark: Dataframes, Datasets And Streaming

Structuring Spark: Dataframes, Datasets And Streaming
Large Scale Deep Learning with TensorFlow

Large Scale Deep Learning with TensorFlow
AI: The New Electricity

AI: The New Electricity
Credit Fraud Prevention with Spark and Graph Analysis

Credit Fraud Prevention with Spark and Graph Analysis
See All Videos

New Apache Spark Packages

Third-party packages that integrate with Apache Spark

sparkMeasure
SparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.
@LucaCanali / created on: August 3, 2018
ammonite-spark
More user-friendly spark-repl via Ammonite
@alexarchambault / created on: July 30, 2018
spark-on-k8s-operator
Kubernetes operator for specifying and running Apache Spark applications idiomatically on Kubernetes.
From: @liyinan926 / owner: @GoogleCloudPlatform / created on: July 20, 2018
spark-bigquery
Google BigQuery data source for Apache Spark
From: @martinstuder / owner: @miraisolutions / created on: July 19, 2018
ParallelTool
Tool design to speed up spark applications
@marino-serna / created on: July 16, 2018
See All Packages

Apache Spark Resources

Find the latest Spark training, mailing lists, forums, and other useful information.
Go to Resources Page

Apache Spark Meetups

There are dozens of active Spark User Meetup groups around the globe. Find one near you.
Go to the Meetups page

Updates in your inbox.

Get the latest Spark news every month in the Databricks Newsletter.

Sign Up Now