This talk describes the Fermilab Virtual Facility project, which incorporates bare-metal machines, our OpenNebula-based private cloud, and commercial clouds. After a number of years of research and development we are now doing stable production of data-intensive analysis and simulation for High Energy Experiments on the cloud.
I will pay special attention to the auxiliary services such as code caching, data caching, job submission, autoscaling, and load balancing that we are launching in the cloud. I will also review other significant developments by others in the field with which Fermilab is not directly involved.
Steven Timm has worked on cloud and virtualization issues for the Scientific Computing Division at Fermilab. The new Virtual Facility Project is a way to transparently extend Fermilab’s facility onto commercial and community clouds.