NPU Design for Diffusion Language Model Inference

Binglei Lou, Haoran Wu, Kevin Lau +9

Diffusion-based LLMs (dLLMs) fundamentally depart from traditional autoregressive (AR) LLM inference: they leverage bidirectional attention, block-wise KV cache refreshing, cross-s…