Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers

Bingxin Xing, Yu Zhang, Jiatong Ding +2

Diffusion Transformers (DiTs) have become a common backbone for high-quality text-to-image and text-to-video generation, but repeated dense self-attention remains a major inference…