activity
20242026
most citedBreak the Sequential Dependency of LLM Inference Using Lookahead Decoding

3 citations · 5 across the 7 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.CL2025

Fast and Accurate Causal Parallel Decoding using Jacobi Forcing

Lanxiang Hu, Siqi Kou, Yichao Fu +5

Multi-token generation has emerged as a promising paradigm for accelerating transformer-based large model inference. Recent efforts primarily explore diffusion Large Language Model…

cs.LG2025

Scaling Speculative Decoding with Lookahead Reasoning

Yichao Fu, Rui Ge, Zelei Shao +2

Reasoning models excel by generating long chain-of-thoughts, but decoding the resulting thousands of tokens is slow. Token-level speculative decoding (SD) helps, but its benefit is…