Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Monday, September 28 • 14:00 - 14:50
Dynamics of Benchmarking Distributed Key-Value(KV) Store (Hbase, Cassandra, Accumulo, Hypertable, Aerospike) for Hosting TeraBytes of Data - Pracheer Agarwal, Inmobi & Kunal Gautam, Inmobi

Sign up or log in to save this to your schedule and see who's attending!

Identifying a KV store to host terabytes of data, from wide range of choices, for a set of given use cases, is a daunting proposition. Even after crossing the fearsome first step and narrowing down the candidates, it is non-trivial to explain and reason the actual results of benchmarking experiments with the expected results. There are multiple variables at play and it is not often clear on how these interplay at run time.
In this talk, we present our experiences and methodology of how to analyze and effectively benchmark a distributed KV store. This involves monitoring and characterizing key server parameters like RAM, CPU, network, storage, page cache, IO scheduler, JVM size, GC tuning and logically reason out their effects on the overall performance and capabilities of the underlying KV store. These parameters were monitored by utilities like iostat, dstat, iftop, jstat and cachestat

Speakers
avatar for Kunal Gautam

Kunal Gautam

Senior Software Engineer, Inmobi
Kunal Gautam is a strong thought leader in the field of Big data and has hands on experience in using Hadoop framework. Very talented and received several awards for providing ideas and implementing them to working product.Kunal has been working with distributed architectures over last 5+ years. He has expertise in using BigData to build from scratch User Profiling(RealTime/Batch) at scale(handles about 2 billion users , 200+TB of data ). | He... Read More →


Monday September 28, 2015 14:00 - 14:50
Krudy/Jokai

Attendees (19)