4 papers
Speculative Pipeline Decoding: Higher-Accuracy Drafting with Hidden Latency via Pipeline Parallelism
Yijiong Yu, Huazheng Wang, Shuai Yuan +2
Speculative Decoding (SD) accelerates low-concurrency LLM inference with a draft-then-verify paradigm. Mainstream methods, however, rely on multi-token prediction, which incurs com…
Personalizing Mathematical Game-based Learning for Children: A Preliminary Study
Jie Gao, Adam K. Dubé
Game-based learning (GBL) is widely adopted in mathematics education. It enhances learners' engagement and critical thinking throughout the mathematics learning process. However, e…
Accelerate Parallelizable Reasoning via Parallel Decoding within One Sequence
Yijiong Yu
Recent advances in reasoning models have demonstrated significant improvements in accuracy by employing detailed and comprehensive reasoning processes. However, generating these le…
Patience Is The Key to Large Language Model Reasoning
Yijiong Yu
Recent advancements in the field of large language models, particularly through the Chain of Thought (CoT) approach, have demonstrated significant improvements in solving complex p…