23 citations · 25 across the 5 of their papers we have counts for
5 papers
ZCCL: Significantly Improving Collective Communication With Error-Bounded Lossy Compression
Jiajun Huang, Sheng Di, Xiaodong Yu +12
With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critic…
LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale +6
Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational de…
MPI Progress For All
Hui Zhou, Robert Latham, Ken Raffenetti +2
The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in achieving effective com…
Designing and Prototyping Extensions to MPI in MPICH
Hui Zhou, Ken Raffenetti, Yanfei Guo +3
As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerfu…
MPIX Stream: An Explicit Solution to Hybrid MPI+X Programming
Hui Zhou, Ken Raffenetti, Yanfei Guo +1
The hybrid MPI+X programming paradigm, where X refers to threads or GPUs, has gained prominence in the high-performance computing arena. This corresponds to a trend of system archi…