Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, September 29 • 10:30 - 11:20
High-Throughput Processing With Streaming-OODT - Michael Starch, NASA Jet Propulsion Laboratory

Sign up or log in to save this to your schedule and see who's attending!

Upcoming customers of Streaming-OODT have predicted that their system will operate at data throughputs of 10Gb/s. Thus in order to use Streaming-OODT at these throughputs, the system must be characterized and well understood in order to support customers’ needs. This presentation discusses Streaming-OODT’s performance processing non-trivial data at these scales and the lessons learned from operation in this environment.

Streaming-OODT uses various other Apache technologies to support its mission to provide a high-performance data system. These technologies include: Apache Kafka, Apache Spark, Spark Streaming, and Apache Mesos. This presentation will therefore discuss the performance of these technologies working together at high-throughputs and will discuss lessons learned orchestrating these technologies for high-performance as part of the Streaming OODT system.

Speakers
MS

Michael Starch

Computer Engineer in Applications, NASA Jet Propulsion Laboratory
Michael Starch has been employed by the Jet Propulsion laboratory for the past 5 years. His primary responsibilities include: engineering big data processing systems for handling scientific data, researching the next generation of big data technologies, and helping infuse these systems into the mission world. He is a commiter and PMC on Apache OODT and has spoken about his work at the Southern California Linux Expo and ApacheCon North America.


Tuesday September 29, 2015 10:30 - 11:20
Tas

Attendees (26)