5 citations · 8 across the 18 of their papers we have counts for
4 papers · 1 filter
Replay the Curvature: Accurate and Scalable NVFP4 Quantization for Large Language Model Inference
Ruiyi Ding, Jie Li, Kang He +4
Large language models make weight storage and memory traffic major inference costs, motivating low-precision formats that represent each weight with only a few bits. Such formats u…
Latent Reward Registers for Diffusion Preference Alignment
Yuanshen Guan, Zipeng Feng, Chengru Song +2
Aligning diffusion models with human preferences usually relies on a sparse terminal reward evaluated on the final generated samples, which creates a severe temporal credit-assignm…
JAGG: Jacobian-Aggregated Group Gradient for Efficient GRPO Training of Diffusion Models
Ruiyi Ding, Jie Li, He Kang +3
Group Relative Policy Optimization (GRPO) is a powerful reinforcement learning algorithm for aligning generative models with human preferences. While successful in large language m…
SlimPipe: Memory-Thrifty and Efficient Pipeline Parallelism for Long-Context LLM Training
Zhouyang Li, Yuliang Liu, Wei Zhang +4
Pipeline Parallelism (PP) serves as a crucial technique for training Large Language Models (LLMs), owing to its capability to alleviate memory pressure from model states with relat…