23 citations · 39 across the 7 of their papers we have counts for
7 papers
LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale +6
Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational de…
Designing and Prototyping Extensions to MPI in MPICH
Hui Zhou, Ken Raffenetti, Yanfei Guo +3
As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerfu…
Frustrated with MPI+Threads? Try MPIxThreads!
Hui Zhou, Ken Raffenetti, Junchao Zhang +2
MPI+Threads, embodied by the MPI/OpenMP hybrid programming model, is a parallel programming paradigm where threads are used for on-node shared-memory parallelization and MPI is use…
Generating Bindings in MPICH
Hui Zhou, Ken Raffenetti, Wesley Bland +1
The MPI Forum has recently adopted a Python scripting engine for generating the API text in the standard document. As a by-product, it made available reliable and rich descriptions…
Quantifying the Performance Benefits of Partitioned Communication in MPI
Thomas Gillis, Ken Raffenetti, Hui Zhou +2
Partitioned communication was introduced in MPI 4.0 as a user-friendly interface to support pipelined communication patterns, particularly common in the context of MPI+threads. It…
Accelerating MPI Collectives with Process-in-Process-based Multi-object Techniques
Jiajun Huang, Kaiming Ouyang, Yujia Zhai +8
In the exascale computing era, optimizing MPI collective performance in high-performance computing (HPC) applications is critical. Current algorithms face performance degradation d…