Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
Speculative Pipeline Decoding: Higher-Accuracy Drafting with Hidden Latency via Pipeline Parallelism
Yijiong Yu, Huazheng Wang, Shuai Yuan +2
Speculative Decoding (SD) accelerates low-concurrency LLM inference with a draft-then-verify paradigm. Mainstream methods, however, rely on multi-token prediction, which incurs com…
cs.CL2025
Accelerate Parallelizable Reasoning via Parallel Decoding within One Sequence
Yijiong Yu
Recent advances in reasoning models have demonstrated significant improvements in accuracy by employing detailed and comprehensive reasoning processes. However, generating these le…
cs.CL2024
Patience Is The Key to Large Language Model Reasoning
Yijiong Yu
Recent advancements in the field of large language models, particularly through the Chain of Thought (CoT) approach, have demonstrated significant improvements in solving complex p…