Loading…
ApacheCon North America 2014 has ended
Register Now for ApacheCon North America 2014 - April 7-9 in Denver, CO. Registration fees increase on March 15th, so don’t delay!
Back To Schedule
Tuesday, April 8 • 4:45pm - 5:35pm
Extend YARN to support complicated workloads other than map-reduce

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Apache Hadoop YARN is a sub-project of Hadoop at the Apache Software Foundation introduced in Hadoop 2.0 that target to run different types of workloads, all sharing a common resource management platform. Over the past two years, we've tried to integrate some other frameworks like OpenMPI to YARN, we encountered limitations for YARN to support different workloads beyond map-reduce.

This talk will describe 3 areas on how to make YARN to support complicated workloads other than map-reduce.
1) An improvement for flexible container resource management, thus will make application can dynamically increase and decrease resource of a running process.
2) An extended service container to run/manage daemon/service processes in each node.
3) Our thoughts to support new opportunities like virtualized platform support, etc. upon improvements we've done to YARN.
Speakers
ML

Michael Lv

Pivotal
Michael Lv works for Pivotal as a senior staff and currently is focussing on big data platform and frameworks. Michael has built Pivotal HD(then called Greenplum HD) Hadoop distribution from the beginning and led the team shipped half dozen product releases. Before joining Pivotal... Read More →

Tuesday April 8, 2014 4:45pm - 5:35pm PDT
Confluence A
  Big Data-Resource Management Track

Attendees (0)