MassAlloc Attention: Let Attention Allocate Its Own Compute

Jingze Shi, Zhangyang Peng, Xianduo Li +6

FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce…