283 citations · 814 across the 69 of their papers we have counts for
Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing
Guannan Lai, Han-Jia Ye
Large language model (LLM) routing aims to assign each query to the most suitable model from a heterogeneous candidate pool, improving the quality--efficiency trade-off of LLM infe…
cs.AI2026
ResiSpec: Enhancing Multi-Candidate Speculative Sampling via Residual Distribution Shaping
Zhi-Kai Chen, Jun-Jie Tao, Wei-Xiang Mao +2
The efficiency of Large Language Model (LLM) serving is fundamentally limited by the sequential nature of autoregressive decoding. Speculative Decoding (SD) mitigates this by using…