2 papers
cs.CL2026
EvoSpec: Evolving Speculative Decoding via Real-Time Vocabulary and Parameter Adaptation
Shuyu Zhang, Lingfeng Pan, Qicheng Wang +6
Speculative decoding accelerates Large Language Model inference through draft-then-verify generation, yet lightweight draft models face coupled efficiency and quality limitations:…
cs.LG2025
SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
Xingrun Xing, Boyan Gao, Zheng Zhang +5
Recent advancements in large language models (LLMs) with billions of parameters have improved performance in various applications, but their inference processes demand significant…