Loading…
Back To Schedule
Tuesday, September 29 • 10:30 - 11:20
High-Throughput Processing With Streaming-OODT - Michael Starch, NASA Jet Propulsion Laboratory

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Upcoming customers of Streaming-OODT have predicted that their system will operate at data throughputs of 10Gb/s. Thus in order to use Streaming-OODT at these throughputs, the system must be characterized and well understood in order to support customers’ needs. This presentation discusses Streaming-OODT’s performance processing non-trivial data at these scales and the lessons learned from operation in this environment.

Streaming-OODT uses various other Apache technologies to support its mission to provide a high-performance data system. These technologies include: Apache Kafka, Apache Spark, Spark Streaming, and Apache Mesos. This presentation will therefore discuss the performance of these technologies working together at high-throughputs and will discuss lessons learned orchestrating these technologies for high-performance as part of the Streaming OODT system.
Speakers
MS

Michael Starch

Computer Engineer in Applications, NASA Jet Propulsion Laboratory
Michael Starch has been employed by the Jet Propulsion laboratory for the past 5 years. His primary responsibilities include: engineering big data processing systems for handling scientific data, researching the next generation of big data technologies, and helping infuse these systems... Read More →

Tuesday September 29, 2015 10:30 - 11:20 CEST
Tas
  Streaming - Pipelining - IoT

Attendees (0)