Apache: Big Data 2015

Apache Flink is an open-source framework for parallel data analysis. The core of Flink is a distributed stream processing engine that provides exactly-once semantics, low-latency processing, and system-managed operator state. Flink's high-level programming APIs and support for batch processing, make Flink a good choice for real-time data analysis. Apache Flink is one of the most active big data project in the Apache Software Foundation and has more than 100 contributors.

This talk presents Flink's architecture and design decisions that result in Flink's unique set of features. It discusses the pipelined execution engine for low latency processing, the operator state management and fault tolerance mechanisms. It will cover master high availability and system monitoring and also show a performance evaluation of the system.