Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, September 29 • 11:30 - 12:20
How Bigtop Leveraged Docker for Build Automation and One-Click Hadoop Provisioning - Evans Ye, Trend Micro

Sign up or log in to save this to your schedule and see who's attending!

Apache Bigtop as an open source Hadoop distribution, focuses on developing packaging, testing and deployment solutions that helps infrastructure engineers to build up their own customized bigdata platform as easy as possible. However, packages deployed in production require a solid CI testing framework to ensure its quality. Numbers of Hadoop component must be ensured to work perfectly together as well. In this presentation, we'll talk about how Bigtop deliver its containerized CI framework which can be directly replicated by Bigtop users. The core revolution here is the newly developed Hadoop provisioner that leveraged Docker for infra automation. The content of this talk includes the technical details of Bigtop Hadoop provisinoer, a hierarchy of docker images we designed, and several components we developed such as Bigtop Toolchain to achieve build automation.

Speakers
avatar for Yu-Hsin Yeh

Yu-Hsin Yeh

Sr. Software Engineer, Trend Micro
Evans Ye(Yu-hsin Yeh) is currently a Committer and PMC member of Apache Bigtop. He works at Trend Micro developing big data infra and applications. He loves to code, automate things, and develop big data solutions. Aside engineering stuff, he is also an enthusiast in giving talks to share software innovations and cutting edge technologies. Evans had talked about Bigtop’s recent improvements by leveraging Docker in Apache: Big Data EU 2015. In... Read More →


Tuesday September 29, 2015 11:30 - 12:20
Krudy/Jokai

Attendees (24)