Cloud Abstractions

- - posted in cloud, scalability

Many of us are working on code bases that require high scalability. In this context, there are a couple patterns I have observed over the past year that appear to be formalizing. Both of these could impact our work.

The first is Docker. If you have not used it, the platform abstracts the OS and greatly simplifies deployment. It provides the advantages of a VM, without the weight/size. If a virtual machine is applications+libraries+operatingSystem, then docker is applications+libraries.
https://www.youtube.com/watch?v=ZzQfxoMFH0U
https://www.docker.com/

The second pattern is abstracting the datacenter into one machine. There are two successful projects. The first started at Twitter, Mesos. The second is from Google, Kubernetes, leverages Docker.
https://www.youtube.com/watch?v=Cby5180Q5_o
https://github.com/GoogleCloudPlatform/kubernetes

Both Mesos and Kubernetes are open source.

Yesterday Google announced an integration of Mesosphere and Kubernetes. They are focusing on providing the scale and horsepower, previously only available to Google, to the open market. That is, the new startups will have access to the same computing resources as the big players.
http://googlecloudplatform.blogspot.com/

Food for thought.