ApacheCon North America 2014

Apache Helix is a generic cluster management framework that simplifies building large scale distributed systems. YARN is a generic resource manager that provides container-based resource allocation to achieve scalable application deployment, management, and monitoring. Integrating the abilities of Helix and YARN has great potential: This talk will provide insights into how one can leverage Helix and YARN to build, configure and deploy distributed systems. The life cycle of a distributed system consists of building the system, auto provisioning, deploying, configuring, handling failures, auto scaling up/down as per work load. This talk will showcase how Helix and YARN can be leveraged to tackle various challenges involved in each stage. Finally, we will show how integrating with Helix will enable the application to be run on a variety of systems such as YARN/Mesos/EC2.