51 citations · 110 across the 17 of their papers we have counts for
6 papers · 1 filter
Parsl+CWL: Towards Combining the Python and CWL Ecosystems
Nishchay Karle, Ben Clifford, Yadu Babuji +3
The Common Workflow Language (CWL) is a widely adopted language for defining and sharing computational workflows. It is designed to be independent of the execution engine on which…
LSHBloom: Memory-efficient, Extreme-scale Document Deduplication
Arham Khan, Robert Underwood, Carlo Siebenschuh +7
Contemporary large language model (LLM) training pipelines require the assembly of internet-scale databases full of text data from a variety of sources (e.g., web, academic, and pu…
Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning
Nathaniel Hudson, Valerie Hayot-Sasson, Yadu Babuji +5
Federated Learning (FL) is a decentralized machine learning paradigm where models are trained on distributed devices and are aggregated at a central server. Existing FL frameworks…
Employing Artificial Intelligence to Steer Exascale Workflows with Colmena
Logan Ward, J. Gregory Pauloski, Valerie Hayot-Sasson +6
Computational workflows are a common class of application on supercomputers, yet the loosely coupled and heterogeneous nature of workflows often fails to take full advantage of the…
GreenFaaS: Maximizing Energy Efficiency of HPC Workloads with FaaS
Alok Kamatar, Valerie Hayot-Sasson, Yadu Babuji +6
Application energy efficiency can be improved by executing each application component on the compute element that consumes the least energy while also satisfying time constraints.…
UniFaaS: Programming across Distributed Cyberinfrastructure with Federated Function Serving
Yifei Li, Ryan Chard, Yadu Babuji +3
Modern scientific applications are increasingly decomposable into individual functions that may be deployed across distributed and diverse cyberinfrastructure such as supercomputer…