INDIGO-DataCloud:A data and computing platform to facilitate seamless access to e-infrastructures

Abstract

This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.

arXiv comment39 pages, 15 figures.Version accepted in Journal of Grid Computing

References in corpus (6)

• An introduction to Docker for reproducible research, with examples from the R environment
• Enabling rootless Linux Containers in multi-user environments: the udocker tool
• Orchestrating Complex Application Architectures in Heterogeneous Clouds
• Standards for enabling heterogeneous IaaS cloud federations
• Phenomenology Tools on Cloud Infrastructures using OpenStack
• Improved Cloud resource allocation: how INDIGO-DataCloud is overcoming the current limitations in Cloud schedulers

Cited by in corpus (1)

• An efficient cloud scheduler design supporting preemptible instances