Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Wednesday, September 30 • 10:00 - 10:50
Configuring and Optimizing Spark Applications with Ease - Nishkam Ravi, Cloudera

Sign up or log in to save this to your schedule and see who's attending!

Spark API exports intuitive and performant one-liners for data processing, which hide complexity and allow applications to be developed quickly. As an in-memory system, Spark has to be configured properly for performance and stability. This can sometimes be challenging. Based on internal deployments and interaction with customers, we conclude that (i) most Spark woes can be traced back to misconfiguration, and (ii) there is a need for tools that can aid configuration, performance optimization and debugging. In this talk, we will discuss common Spark configuration pitfalls and show how they can be avoided with the help of the auto-configuration and optimization tool being developed at Cloudera.

Speakers
NR

Nishkam Ravi

Software Engineer, Cloudera
Nishkam is a Software Engineer at Cloudera. His current focus is Spark and MapReduce performance. Nishkam got his B.Tech from IIT-Bombay and PhD from Rutgers. His first job was with Intel as a compiler engineer. Prior to joining Cloudera, Nishkam was a Research Staff Member at NEC Labs where he developed an optimizing compiler for MapReduce. He has presented in numerous peer reviewed AI and systems conferences in the past. | | Hari is a... Read More →


Wednesday September 30, 2015 10:00 - 10:50
Dery/Mikszath

Attendees (32)