Apache: Big Data 2015

While designed to provide high-throughput, low-latency real-time data feeds of relatively small messages on a large scale Apache Kafka could offer a valuable service to alternative communities if operated at the even greater scale managing on the order of 10Gb/s streams.

While others have achieved this level of throughput via topic scaling using greater node counts, this presentation will discuss achieving such rates over a single topic and where hardware resource scaling is more limited.