ApacheCon North America 2014

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications. It can run and manage Apache Hadoop, Apache Spark, MPI, Hypertable, Storm, Chronos, Marathon, and other applications on a dynamically shared pool of nodes. Mesos provides distributed systems primitives that make it easy to build scalable, fault-tolerant frameworks.
The biggest user of Mesos is currently Twitter, where it runs on tens of thousands of cores. Airbnb runs all of their data infrastructure on it, processing petabytes of data. At such large scale, it becomes increasingly important to provide developers with direct access to cluster resources, for scaling and introducing new services. In this way, Mesos speeds development and makes life easier for the data center operator.