Publications (21)
Performance Modeling of Distributed Deep Neural Networks
Sayed Hadi Hashemi, Shadi A. Noghabi, William Gropp +1
During the past decade, machine learning has become extremely popular and can be found in many aspects of our every day life. Nowayadays with explosion of data while rapid growth o…
Deep Learning for Multi-Messenger Astrophysics: A Gateway for Discovery in the Big Data Era
Gabrielle Allen, Igor Andreoni, Etienne Bachelet +45
This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrop…
Now More Than Ever, Foundational AI Research and Infrastructure Depends on the Federal Government
Michela Taufer, Rada Mihalcea, Matthew Turk +13
Leadership in the field of AI is vital for our nation's economy and security. Maintaining this leadership requires investments by the federal government. The federal investment in…
HiCCL: A Hierarchical Collective Communication Library
Mert Hidayetoglu, Simon Garcia de Gonzalo, Elliott Slaughter +4
HiCCL (Hierarchical Collective Communication Library) addresses the growing complexity and diversity in high-performance network architectures. As GPU systems have envolved into ne…
Advancing Computing's Foundation of US Industry & Society
Thomas M. Conte, Ian T. Foster, William Gropp +1
While past information technology (IT) advances have transformed society, future advances hold even greater promise. For example, we have only just begun to reap the changes from a…
Learning with Analytical Models
Huda Ibeid, Siping Meng, Oliver Dobon +2
To understand and predict the performance of scientific applications, several analytical and machine learning approaches have been proposed, each having its advantages and disadvan…
Reclaiming the Future: American Information Technology Leadership in an Era of Global Competition
Alex Aiken, David Jensen, Catherine Gill +5
The United States risks losing its global leadership in information technology research due to declining basic research funding, challenges in attracting talent, and tensions betwe…
MIRGE: An Array-Based Computational Framework for Scientific Computing
Matthias Diener, Matthew J. Smith, Michael T. Campbell +6
MIRGE is a computational approach for scientific computing based on NumPy-like array computation, but using lazy evaluation to recast computation as data-flow graphs, where nodes r…
Exploring Spatial Indexing for Accelerated Feature Retrieval in HPC
Margaret Lawson, William Gropp, Jay Lofstead
Despite the critical role that range queries play in analysis and visualization for HPC applications, there has been no comprehensive analysis of indices that are designed to accel…
Understanding the Landscape of Ampere GPU Memory Errors
Zhu Zhu, Yu Sun, Dhatri Parakal +9
Graphics Processing Units (GPUs) have become a de facto solution for accelerating high-performance computing (HPC) applications. Understanding their memory error behavior is an ess…
Infrastructure for Artificial Intelligence, Quantum and High Performance Computing
William Gropp, Sujata Banerjee, Ian Foster
High Performance Computing (HPC), Artificial Intelligence (AI)/Machine Learning (ML), and Quantum Computing (QC) and communications offer immense opportunities for innovation and i…
Optimizing Noncontiguous Accesses in MPI-IO
Rajeev Thakur, William Gropp, Ewing Lusk
The I/O access patterns of many parallel applications consist of accesses to a large number of small, noncontiguous pieces of data. If an application's I/O needs are met by making…
Noncontiguous I/O through PVFS
Avery Ching, Alok Choudhary, Wei-keng Liao +2
With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of para…
Parallel netCDF: A Scientific High-Performance I/O Interface
Jianwei Li, Wei-keng Liao, Alok Choudhary +4
Dataset storage, exchange, and access play a critical role in scientific applications. For such purposes netCDF serves as a portable and efficient file format and programming inter…
Design and Implementation of MPICH2 over InfiniBand with RDMA Support
Jiuxing Liu, Weihang Jiang, Pete Wyckoff +5
For several years, MPI has been the de facto standard for writing parallel applications. One of the most popular MPI implementations is MPICH. Its successor, MPICH2, features a com…
Reducing Communication in Algebraic Multigrid with Multi-step Node Aware Communication
Amanda Bienz, Luke Olson, William Gropp
Algebraic multigrid (AMG) is often viewed as a scalable solver for sparse linear systems. Yet, parallel AMG lacks scalability due to increasingly large costs assoc…
Performance Analysis and Optimal Node-Aware Communication for Enlarged Conjugate Gradient Methods
Shelby Lockhart, Amanda Bienz, William Gropp +1
Krylov methods are a key way of solving large sparse linear systems of equations, but suffer from poor strong scalabilty on distributed memory machines. This is due to high synchro…
Enabling real-time multi-messenger astrophysics discoveries with deep learning
E. A. Huerta, Gabrielle Allen, Igor Andreoni +57
Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that…
The Post-Quantum Cryptography Transition: Making Progress, But Still a Long Road Ahead
Brian LaMacchia, Matt Campagna, William Gropp
The development of quantum computing threatens the security of our currently widely deployed cryptographic algorithms. While signicant progress has been made in developing post-qua…
FFT, FMM, and Multigrid on the Road to Exascale: performance challenges and opportunities
Huda Ibeid, Luke Olson, William Gropp
FFT, FMM, and multigrid methods are widely used fast and highly scalable solvers for elliptic PDEs. However, emerging large-scale computing systems are introducing challenges in co…
Components and Interfaces of a Process Management System for Parallel Programs
Ralph Butler, William Gropp, Ewing Lusk
Parallel jobs are different from sequential jobs and require a different type of process management. We present here a process management system for parallel programs such as those…