This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now for ApacheCon North America 2014 - April 7-9 in Denver, CO. Registration fees increase on March 15th, so don’t delay!
View analytic
Tuesday, April 8 • 4:45pm - 5:35pm
Extend YARN to support complicated workloads other than map-reduce

Sign up or log in to save this to your schedule and see who's attending!

Apache Hadoop YARN is a sub-project of Hadoop at the Apache Software Foundation introduced in Hadoop 2.0 that target to run different types of workloads, all sharing a common resource management platform. Over the past two years, we've tried to integrate some other frameworks like OpenMPI to YARN, we encountered limitations for YARN to support different workloads beyond map-reduce.

This talk will describe 3 areas on how to make YARN to support complicated workloads other than map-reduce.
1) An improvement for flexible container resource management, thus will make application can dynamically increase and decrease resource of a running process.
2) An extended service container to run/manage daemon/service processes in each node.
3) Our thoughts to support new opportunities like virtualized platform support, etc. upon improvements we've done to YARN.


Michael Lv

Michael Lv works for Pivotal as a senior staff and currently is focussing on big data platform and frameworks. Michael has built Pivotal HD(then called Greenplum HD) Hadoop distribution from the beginning and led the team shipped half dozen product releases. Before joining Pivotal in early 2011, Michael worked within EMC CTO office as an architect and team lead focusing on virtualized data center(aka private cloud), cloud platform and big data... Read More →

Tuesday April 8, 2014 4:45pm - 5:35pm
Confluence A

Attendees (18)