From the 1 of 10 linked papers with an AI index.
10 papers
Zellige: Moldable Sequence Placement for Mixed Image-Video DiT Training
Guangyu Xiang, Xueze Kang, Minwei Zhao +4
High-quality video generation requires training Diffusion Transformers (DiTs) jointly on image and video data, posing a mixed-length sequence training problem across GPUs. Existing…
Xema: Efficient Diffusion Serving through Fine-Grained Memory Management and Auto-Configuration
Xueze Kang, Guangyu Xiang, Suyi Li +4
Xema is a system that reduces GPU memory usage for diffusion model serving by analyzing tensor lifetimes to apply targeted memory mitigation and by planning parallelism and concurr…
Bidirectional Resource Scheduling for Disaggregated and Asynchronous RL Post-Training
Tan Zhiqiang, Zhiqiang Tan, Maoxin Wang +11
It is well established that the reasoning capabilities of large language models (LLMs) can be improved by applying reinforcement learning (RL) in a post-training stage. In a standa…
KernelFlume: Elastic Core-Attention Scaling for Agentic Long-Context Decoding
Guangyu Xiang, Xueze Kang, Lin Zhang +4
LLM serving is increasingly dominated by long and dynamic decode workloads from agents, reasoning models, and extended conversations. When bursty long-context demand exceeds deploy…
AGoQ: Activation and Gradient Quantization for Memory-Efficient Distributed Training of LLMs
Wenxiang Lin, Juntao Huang, Luhan Zhang +5
Quantization is a key method for reducing the GPU memory requirement of training large language models (LLMs). Yet, current approaches are ineffective for 4-bit activations and 8-b…
Janus: Disaggregating Attention and Experts for Scalable MoE Inference
Zhexiang Zhang, Ye Wang, Yumiao Zhao +10
Serving large Mixture-of-Experts (MoE) models is challenging because of their large memory footprints, heterogeneous resource demands, and highly dynamic inference workloads. Most…