Exo-GPU: Safe, Imperative, User-schedulable Programming for Tensor Cores

David Zhao Akeley, Yuka Ikarashi, Jonathan Ragan-Kelley

Modern GPUs require not only SIMT-style parallelism but also software-managed concurrency between compute and data movement to reach maximum performance. Performance engineers must…