Loading Events

« All Events

  • This event has passed.

Pre-Spark Summit Bay Area Apache Spark Meetup @ Moscone Center SF

June 5, 2017 @ 6:00 pm - 9:00 pm

Moscone Center, Rm 2014

Join us for an evening of Bay Area Apache Spark Meetup at the 10th Spark Summit featuring tech-talks about using Apache Spark at scale from Pepperdata’s CTO Sean Suchter, RISELab’sDan Crankshaw, and Databricks’ Spark committers and contributors.

Thanks to Pepperdata for sponsoring the meetup.

(Note: This meetup is open to everyone. You don’t have to be registered for Spark Summit.)


6:00 – 6:30 pm  Mingling & Refreshments

6:30 – 6:40 pm Opening Remarks & Introductions from Jules Damji

6:40 – 7:20 pm Pepperdata  Tech Talk 1 from Sean Suchter

7:20 – 8:00 pm RISELab Tech Talk 2 from Dan Crankshaw

8:00 – 8:05 pm Short Break

8:05 – 8:45 pm Tech Talk 3 Ask Me Anything About Spark (Databricks’ Spark committers/contributors)

8:45 – 9:00 pm  More Mingling  & Networking

Pepperdata: Tech-Talk 1: Apache Spark Internals: Connecting Your Code to Spark Internals

Abstract: Apache Spark is a dynamic execution engine that can take relatively simple Scala code and create complex and optimized execution plans. In this talk, we will describe how user code translates into Spark drivers, executors, stages, tasks, transformations, and shuffles. We will then describe how this is critical to the design of Spark and how this tight interplay allows very efficient execution. We will also discuss various sources of metrics on how Spark applications use hardware resources, and show how application developers can use this information to write more efficient code. Users and operators who are aware of these concepts will become more effective at their interactions with Spark.

Bio: Sean Suchter, CTO, Pepperdata – Sean co-founded Pepperdata along with Chad Carson. Previously, Sean was the founding GM of Microsoft’s Silicon Valley Search Technology Center, where he led the integration of Facebook and Twitter content into Bing search. Prior to Microsoft, Sean managed the Yahoo Search Technology team, the first production user of Hadoop. Sean joined Yahoo through the acquisition of Inktomi, and holds a B.S. in Engineering and Applied Science from Caltech.

RISELab: Tech-Talk 2Deploying Real-Time Machine-Learning Applications with the Clipper Model Serving System

Abstract: Machine learning is being deployed in a growing number of applications which demand real-time, accurate, and robust predictions under heavy serving loads. However, most machine learning frameworks and systems only address model training and not deployment.
Clipper is a general-purpose model-serving system that addresses these challenges. Interposing between applications that consume predictions and the machine-learning models that produce predictions, Clipper simplifies the model deployment process by isolating models in their own containers and communicating with them over a lightweight RPC system. This architecture allows models to be deployed for serving in the same runtime environment as that used during training. Further, it provides simple mechanisms for scaling out models to meet increased throughput demands and performing fine-grained physical resource allocation for each model.

In this talk I will provide an overview of the Clipper serving system and then discuss how to get started using Clipper to serve Spark and TensorFlow models in a production serving environment.

Bio: Dan Crankshaw is a PhD student in the UC Berkeley CS department working in the RISELab. After cutting his teeth doing large-scale data analysis on cosmology simulation data and building systems for distributed graph analysis, he turned his attention to systems for machine learning. His current research interests include systems and techniques for serving and deploying machine learning, with a particular emphasis on low-latency and interactive applications.

Databricks : Tech-Talk 3: Ask Me Anything About Apache Spark (AMA)

Abstract: Join Apache Spark core committers and contributors for answering ALL your Spark related questions!


Pre-Spark Summit Bay Area Apache Spark Meetup @ Moscone Center SF


June 5, 2017
6:00 pm - 9:00 pm
Event Categories:
Event Tags:


Moscone Center
747 Howard Street,
San Francisco, CA United States
+ Google Map