2 papers
cs.DC2026
X-Stage: An Overlooked Pipeline Stage for Communication-Computation Overlap in DiT Inference
Jianwen Xian, Zhiyuan Xu, Yuchen Li +8
Fine-grained, device-initiated communication lets persistent GPU kernels in distributed diffusion transformer (DiT) inference issue remote stores and overlap data movement with Ten…
cs.LG2026
AIConfigurator: Lightning-Fast Configuration Optimization for Multi-Framework LLM Serving
Tianhao Xu, Yiming Liu, Xianglong Lu +18
Optimizing Large Language Model (LLM) inference in production systems is increasingly difficult due to dynamic workloads, stringent latency/throughput targets, and a rapidly expand…