Back To Schedule
Wednesday, September 30 • 10:00 - 10:50
How to Deploy a Secure, High-Available, Hadoop Platform - Olaf Flebbe, science+computing ag

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

We demonstrate the fully automatic installation of a hadoop cluster including infrastructure. The basic building blocks of the Demonstration are the Debian Distribution incl. puppet, configuration with hiera, a list of community puppet modules and deploy scripts and packages from the apache bigtop distribution. The automatically installed cluster sports an HA MIT Kerberos and openLDAP setup, apache zookeeper fencing, HA Hadoop ( journalling, and RM). WebGUI’s are authenticated with SPNEGO, Hive is configured with standard SQL authorization and Hue is provided as frontend.

One of the advanced features is the use of puppets CA via PKINIT for preauthentication and bootstrapping a secure kerberos KDC and securing hadoop with it.


Olaf Flebbe

Chief Software Architect
Dr. Olaf Flebbe received his PhD in computational physics in Tübingen, Germany. He works as the chief software architect at science+computing ag. He is a member of the PMC of Apache Bigtop. Occasionally he gives talks about random projects at various conferences.

Wednesday September 30, 2015 10:00 - 10:50 CEST

Attendees (0)