1 paper · 1 filter
Wenrui Bao, Zhiben Chen, Dan Xu +1
Autoregressive decoding in large language models (LLMs) requires O(n) sequential steps for n tokens, fundamentally limiting inference throughput. Recent diffusion-bas…