X-Stage: An Overlooked Pipeline Stage for Communication-Computation Overlap in DiT Inference

Jianwen Xian, Zhiyuan Xu, Yuchen Li +8

Fine-grained, device-initiated communication lets persistent GPU kernels in distributed diffusion transformer (DiT) inference issue remote stores and overlap data movement with Ten…