2 papers
cs.CL2026
KNN-SSD: Enabling Dynamic Self-Speculative Decoding via Nearest Neighbor Layer Set Optimization
Mingbo Song, Heming Xia, Jun Zhang +4
Speculative Decoding (SD) has emerged as a widely used paradigm to accelerate the inference of large language models (LLMs) without compromising generation quality. It works by eff…
cs.LG2025
Adaptive Sparse Softmax: An Effective and Efficient Softmax Variant
Qi Lv, Lei Geng, Ziqiang Cao +4
Softmax with the cross entropy loss is the standard configuration for current neural classification models. The gold score for a target class is supposed to be 1, but it is never r…