1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.DC2025
Fast LLM Post-training via Decoupled and Fastest-of-N Speculation
Rongxin Cheng, Kai Zhou, Xingda Wei +8
Rollout dominates the training time in large language model (LLM) post-training, where the trained model is used to generate tokens given a batch of prompts. This work, SpecActor,…
cs.OS2025
Holistic Heterogeneous Scheduling for Autonomous Applications using Fine-grained, Multi-XPU Abstraction
Mingcong Han, Weihang Shen, Rong Chen +2
Modern autonomous applications are increasingly utilizing multiple heterogeneous processors (XPUs) to accelerate different stages of algorithm modules. However, existing runtime sy…
cs.OS2024★ 1 cited
Microsecond-scale Dynamic Validation of Idempotency for GPU Kernels
Mingcong Han, Weihang Shen, Guanwen Peng +2
We discovered that a GPU kernel can have both idempotent and non-idempotent instances depending on the input. These kernels, called conditionally-idempotent, are prevalent in real-…