Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
CATS: Cascaded Adaptive Tree Speculation for Memory-Limited LLM Inference Acceleration
Yuning Han, Yangchenchen Jin, Dylan Zhao +1
Auto-regressive decoding in Large Language Models (LLMs) is inherently memory-bound: every generation step requires loading the model weights and intermediate results from memory (…
cs.LG2026
ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor
Yixiao Wang, Ting Jiang, Zishan Shao +6
Denoising generative models deliver high-fidelity generation but remain bottlenecked by inference latency due to the many iterative denoiser calls required during sampling. Trainin…