Prefilling-dLLM v2: Learned Chunk Routing for Long-Context Diffusion Language Models

Qi Han, Jing Xiong, Ziyuan Zhang +1

Diffusion language models apply bidirectional attention over the whole context at every denoising step, so a longer context makes each step substantially more expensive. Sparsifyin…