Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Toward a Unified GPU-Aware OpenSHMEM Specification
Naveen Ravi, Nathan Wichmann, Md. Wasi-ur- Rahman +19
Leadership-class HPC systems are now accelerator-centric, with GPUs providing most floating-point throughput and memory bandwidth. As next-generation systems increasingly integrate…
cs.DC2024
Demystifying the Communication Characteristics for Distributed Transformer Models
Quentin Anthony, Benjamin Michalowicz, Jacob Hatef +5
Deep learning (DL) models based on the transformer architecture have revolutionized many DL applications such as large language models (LLMs), vision transformers, audio generation…