RT-Lynx: Putting GEMM Sparsity in the Right Place for Diffusion Models

Xing Cong, Hanlin Tang, Kan Liu +3

Diffusion Transformers (DiT) achieve strong performance in image generation but incur substantial inference costs. While prior work has reduced this cost via quantization and disti…