51 citations · 110 across the 17 of their papers we have counts for
20 papers
ExaServe: Large-Scale LLM Serving on Exascale HPC Systems
Wenyi Wang, Shu Shi, Yadu Babuji +2
Cloud-native LLM serving frameworks have made deployment routine in data centers, yet deploying them on leadership-class supercomputers remains an engineering challenge requiring s…
Diamond Agent: Agentic Control of Federated HPC Resources as a Service
Haotian Xie, Junlin Chen, Mingkai Zheng +9
Efficiently aggregating and orchestrating computing power across heterogeneous clusters for HPC workflows faces four practical challenges: preserving workflow context across indepe…
Scalable Agentic Reasoning for Designing Biologics Targeting Intrinsically Disordered Proteins
Matthew Sinclair, Moeen Meigooni, Archit Vasan +14
Intrinsically disordered proteins (IDPs) represent crucial therapeutic targets due to their significant role in disease -- approximately 80\% of cancer-related proteins contain lon…
AERO: An autonomous platform for continuous research
Valérie Hayot-Sasson, Abby Stevens, Nicholson Collier +10
The COVID-19 pandemic highlighted the need for new data infrastructure, as epidemiologists and public health workers raced to harness rapidly evolving data, analytics, and infrastr…
Empowering Scientific Workflows with Federated Agents
Alok Kamatar, J. Gregory Pauloski, Yadu Babuji +5
Agentic systems, in which diverse agents cooperate to tackle challenging problems, are exploding in popularity in the AI community. However, existing agentic frameworks take a rela…
AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine
Carlo Siebenschuh, Kyle Hippe, Ozan Gokdemir +10
Language models for scientific tasks are trained on text from scientific publications, most distributed as PDFs that require parsing. PDF parsing approaches range from inexpensive…
Parsl+CWL: Towards Combining the Python and CWL Ecosystems
Nishchay Karle, Ben Clifford, Yadu Babuji +3
The Common Workflow Language (CWL) is a widely adopted language for defining and sharing computational workflows. It is designed to be independent of the execution engine on which…
LSHBloom: Memory-efficient, Extreme-scale Document Deduplication
Arham Khan, Robert Underwood, Carlo Siebenschuh +7
Contemporary large language model (LLM) training pipelines require the assembly of internet-scale databases full of text data from a variety of sources (e.g., web, academic, and pu…
Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning
Nathaniel Hudson, Valerie Hayot-Sasson, Yadu Babuji +5
Federated Learning (FL) is a decentralized machine learning paradigm where models are trained on distributed devices and are aggregated at a central server. Existing FL frameworks…
Employing Artificial Intelligence to Steer Exascale Workflows with Colmena
Logan Ward, J. Gregory Pauloski, Valerie Hayot-Sasson +6
Computational workflows are a common class of application on supercomputers, yet the loosely coupled and heterogeneous nature of workflows often fails to take full advantage of the…
GreenFaaS: Maximizing Energy Efficiency of HPC Workloads with FaaS
Alok Kamatar, Valerie Hayot-Sasson, Yadu Babuji +6
Application energy efficiency can be improved by executing each application component on the compute element that consumes the least energy while also satisfying time constraints.…
UniFaaS: Programming across Distributed Cyberinfrastructure with Federated Function Serving
Yifei Li, Ryan Chard, Yadu Babuji +3
Modern scientific applications are increasingly decomposable into individual functions that may be deployed across distributed and diverse cyberinfrastructure such as supercomputer…
The Changing Role of RSEs over the Lifetime of Parsl
Daniel S. Katz, Ben Clifford, Yadu Babuji +3
This position paper describes the Parsl open source research software project and its various phases over seven years. It defines four types of research software engineers (RSEs) w…
Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis
Nicholson Collier, Justin M. Wozniak, Abby Stevens +6
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain expert…
Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources
Logan Ward, J. Gregory Pauloski, Valerie Hayot-Sasson +7
Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supe…
funcX: Federated Function as a Service for Science
Zhuozhao Li, Ryan Chard, Yadu Babuji +9
funcX is a distributed function as a service (FaaS) platform that enables flexible, scalable, and high performance remote function execution. Unlike centralized FaaS systems, funcX…
Colmena: Scalable Machine-Learning-Based Steering of Ensemble Simulations for High Performance Computing
Logan Ward, Ganesh Sivaraman, J. Gregory Pauloski +9
Scientific applications that involve simulation ensembles can be accelerated greatly by using experiment design methods to select the best simulations to perform. Methods that use…
Extreme Scale Survey Simulation with Python Workflows
A. S. Villarreal, Yadu Babuji, Tom Uram +3
The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will soon carry out an unprecedented wide, fast, and deep survey of the sky in multiple optical bands. The data…
ExaWorks: Workflows for Exascale
Aymen Al-Saadi, Dong H. Ahn, Yadu Babuji +12
Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific dis…
DESC DC2 Data Release Note
LSST Dark Energy Science Collaboration, Bela Abolfathi, Robert Armstrong +54
In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created…