X-Stage: Modeling Post-Issue Backpressure in GPU Communication--Computation Fusion

Jianwen Xian, Zhiyuan Xu, Yuchen Li +9

Fine-grained, device-initiated communication allows fused GPU kernels to issue remote stores directly from their compute pipelines, a pattern increasingly used in expert parallelis…