Middleware Building Blocks for Workflow Systems
arXiv:1903.10057 · doi:10.1109/MCSE.2019.2920048
Abstract
This paper describes a building blocks approach to the design of scientific workflow systems. We discuss RADICAL-Cybertools as one implementation of the building blocks concept, showing how they are designed and developed in accordance with this approach. This paper offers three main contributions: (i) showing the relevance of the design principles underlying the building blocks approach to support scientific workflows on high performance computing platforms; (ii) illustrating a set of building blocks that enable multiple points of integration, "unifying" conceptual reasoning across otherwise very different tools and systems; and (iii) case studies discussing how RADICAL-Cybertools are integrated with existing workflow, workload, and general purpose computing systems and used to develop domain-specific workflow systems.
References in corpus (1)
Cited by in corpus (6)
- Applying the FAIR Principles to computational workflows
- A Community Roadmap for Scientific Workflows Research and Development
- A Terminology for Scientific Workflow Systems
- Adaptive Ensemble Biomolecular Simulations at Scale
- Deep Generative Model Driven Protein Folding Simulation
- Hydra: Brokering Cloud and HPC Resources to Support the Execution of Heterogeneous Workloads at Scale