259 citations · 478 across the 14 of their papers we have counts for
11 papers · 1 filter
Steering a Fleet: Adaptation for Large-Scale, Workflow-Based Experiments
Jim Pruyne, Valerie Hayot-Sasson, Weijian Zheng +5
Experimental science is increasingly driven by instruments that produce vast volumes of data and thus a need to manage, compute, describe, and index this data. High performance and…
PSI/J: A Portable Interface for Submitting, Monitoring, and Managing Jobs
Mihael Hategan-Marandiuc, Andre Merzky, Nicholson Collier +10
It is generally desirable for high-performance computing (HPC) applications to be portable between HPC systems, for example to make use of more performant hardware, make effective…
Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis
Nicholson Collier, Justin M. Wozniak, Abby Stevens +6
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain expert…
WfBench: Automated Generation of Scientific Workflow Benchmarks
Tainã Coleman, Henri Casanova, Ketan Maheshwari +6
The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class…
ExaWorks: Workflows for Exascale
Aymen Al-Saadi, Dong H. Ahn, Yadu Babuji +12
Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific dis…
Workflows Community Summit: Advancing the State-of-the-art of Scientific Workflows Management Systems Research and Development
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard +55
Scientific workflows are a cornerstone of modern scientific computing, and they have underpinned some of the most significant discoveries of the last decade. Many of these workflow…
Workflows Community Summit: Bringing the Scientific Workflows Community Together
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard +42
Scientific workflows have been used almost universally across scientific domains, and have underpinned some of the most significant discoveries of the past several decades. Many of…
Big Data Staging with MPI-IO for Interactive X-ray Science
Justin M. Wozniak, Hemant Sharma, Timothy G. Armstrong +3
New techniques in X-ray scattering science experiments produce large data sets that can require millions of high-performance processing hours per week of computation for analysis.…
Parsl: Pervasive Parallel Programming in Python
Yadu Babuji, Anna Woodard, Zhuozhao Li +9
High-level programming languages such as Python are increasingly used to provide intuitive interfaces to libraries written in lower-level languages and for assembling applications…
Streaming supercomputing needs workflow-enabled programming-in-the-large
Justin M Wozniak, Jonathan Ozik, Daniel S. Katz +1
This is a position paper, submitted to the Future Online Analysis Platform Workshop (https://press3.mcs.anl.gov/futureplatform/), which argues that simple data analysis application…
Many-Task Computing and Blue Waters
Daniel S. Katz, Timothy G. Armstrong, Zhao Zhang +2
This report discusses many-task computing (MTC) generically and in the context of the proposed Blue Waters systems, which is planned to be the largest NSF-funded supercomputer when…