Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution
Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi +4
A language model can give a correct answer more probability than any single incorrect answer and still usually sample an incorrect one, because the incorrect answers together hold…
cs.LG2025
Improving the Throughput of Diffusion-based Large Language Models via a Training-Free Confidence-Aware Calibration
Jucheng Shen, Gaurav Sarkar, Yeonju Ro +4
We present CadLLM, a training-free method to accelerate the inference throughput of diffusion-based LLMs (dLLMs). We first investigate the dynamic nature of token unmasking confide…