LaCache: Exact Caching and Precision-Adaptive Inference for Diffusion Large Language Models

Xingru Chen, Zelang Liang, Yongjia Ma +4

Diffusion-based Large Language Models(DLLMs) enable parallel generation via Semi-Autoregressive (SAR) decoding in text generation. However, current methods suffer from severe opera…