Back To Schedule
Wednesday, September 30 • 10:00 - 10:50
Configuring and Optimizing Spark Applications with Ease - Nishkam Ravi, Cloudera

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Spark API exports intuitive and performant one-liners for data processing, which hide complexity and allow applications to be developed quickly. As an in-memory system, Spark has to be configured properly for performance and stability. This can sometimes be challenging. Based on internal deployments and interaction with customers, we conclude that (i) most Spark woes can be traced back to misconfiguration, and (ii) there is a need for tools that can aid configuration, performance optimization and debugging. In this talk, we will discuss common Spark configuration pitfalls and show how they can be avoided with the help of the auto-configuration and optimization tool being developed at Cloudera.


Nishkam Ravi

Software Engineer, Cloudera
Nishkam is a Software Engineer at Cloudera. His current focus is Spark and MapReduce performance. Nishkam got his B.Tech from IIT-Bombay and PhD from Rutgers. His first job was with Intel as a compiler engineer. Prior to joining Cloudera, Nishkam was a Research Staff Member at NEC... Read More →

Wednesday September 30, 2015 10:00 - 10:50 CEST

Attendees (1)