51 citations · 242 across the 54 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CL2026
RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding
Zihong Zhang, Zuchao Li, Lefei Zhang +2
Autoregressive decoding in Large Language Models (LLMs) generates one token per step, causing high inference latency. Speculative decoding (SD) mitigates this through a guess-and-v…
cs.AI2026
TrigReason: Trigger-Based Collaboration between Small and Large Reasoning Models
Yi Zhao, Yajuan Peng, Cam-Tu Nguyen +4
Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning.…