Tool
Apache Mesos is an open-source distributed-systems kernel and cluster resource manager developed at Berkeley around 2009 by Benjamin Hindman and maintained by the Apache Software Foundation. It abstracts CPU, memory, storage, ports, GPUs, and other resources from individual machines, presenting a datacenter or cloud environment as a shared resource pool. Its two-level, bring-your-own-scheduler model offers resources to application frameworks while allowing them to provide their own scheduling policies through Mesos APIs. Frameworks such as Hadoop, Spark, Kafka, Elasticsearch, Marathon, Chronos, and Aurora could be assembled on top of it; the system was used at large scale by organizations including Twitter and Apple. Mesos runs agents across clusters with replicated masters and ZooKeeper for fault tolerance, supports Docker and AppC containers, pluggable resource isolation, HTTP APIs, a web interface, and Linux, macOS, and Windows. The Apache Mesos project has retired, and its website directs users to the Apache Attic for details.
2 uses taken from transcripts — each links to the moment in the video.
Berkeley's resource-offer cluster manager with bring-your-own-scheduler design; Kubernetes' main early competitor
Berkeley's open-source cluster resource manager built by Benjamin Hindman around 2009. It offered free resources to frameworks which brought their own schedulers — flexible and proven at Twitter and Apple scale, but demanding: you had to assemble your own orchestration layer out of parts like Marathon, Chronos and Aurora.
1 in the library.