4 papers
WOW: Workflow-Aware Data Movement and Task Scheduling for Dynamic Scientific Workflows
Fabian Lehmann, Jonathan Bader, Friedrich Tschirpke +6
Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM)…
Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows
Fabian Lehmann, Jonathan Bader, Ninon De Mecquenem +5
Scientific workflows are used to analyze large amounts of data. These workflows comprise numerous tasks, many of which are executed repeatedly, running the same custom program on d…
Microservices a Definition Analyzed by ßMACH
Marcus Hilbrich, Ninon De Mecquenem
Managing software artifacts is one of the most essential aspects of computer science. It enables to develop, operate, and maintain software in an engineer-like manner. Therefore, n…
Large Language Models to the Rescue: Reducing the Complexity in Scientific Workflow Development Using ChatGPT
Mario Sänger, Ninon De Mecquenem, Katarzyna Ewa Lewińska +4
Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability,…