Epoch: Compiling Diffusion Blocks for Sparse MoE Serving

Jianian Zhu, Hang Wu, Yinghui Li +3

Diffusion language models generate text by refining a fixed-size block of token positions through many forward passes, a loop that does not match the per-forward execution unit use…