Decoupling Logical Masks from GPU Execution for Dynamic Block-Sparse Attention

Shanghao Liu, Xiaoyun Yu, Wanting Li +1

Attention computation makes inference expensive in video diffusion transformers (vDiTs), which generate videos through iterative denoising. Block-sparse attention (BSA) reduces thi…