Automated Deadline-Based Scaling of Experiments in the Cloud with MiCADO
deRSE 2019 - first Conference for Research Software Engineers
MiCADOscale is open-source, cloud agnostic and uses widely applied technologies - Kubernetes, Occopus and Prometheus - to scale virtual machines and containers in the cloud. In our project, MiCADOscale has been tested on a range of small to large-scale research activities that saw simulations and other multi-job experiments queued, executed and scaled in containers on different public and private clouds.
RSEs contribution to the developing science landscape and IT-dependent research is mainly, but not exclusively, in the area of research software development. They want to prepare science for the ever-increasing influence of new technologies and new IT concepts, and help to cope with the challenges of the increasing digitalisation of research as well as exploit the resulting opportunities.