Training-free sparse attention based on cumulative energy filtering

Chunlu Li, Yixuan Pan, Bai Du +5

Sparse attention accelerates Diffusion Transformers (DiTs) for video generation by computing only the important tokens while skipping the rest. The token selection strategy is key…