FG-Attn: Leveraging Fine-Grained Sparse Attention in Video Diffusion Models

Sankeerth Durvasula, Kavya Sreedhar, Zain Moustafa +6

Using diffusion transformers for media generation may require evaluating attention over extremely long sequences, with attention layers accounting for the majority of generation la…