works on
audio-video processing 1budget allocation 1inference efficiency 1multimodal large language models 1token compression 1

From the 1 of 10 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Draft Less, Retrieve More: Hybrid Tree Construction for Speculative Decoding

Yuhao Shen, Tianyu Liu, Xinyi Hu +9

Speculative decoding (SD) accelerates large language model inference by leveraging a draft-then-verify paradigm. To maximize the acceptance rate, recent methods construct expansive…