Efficient FlashAttention on Blackwell via Fixed-Shift Softmax and Persistent Scheduling

Oleksandr Stashuk, Hongtao Yu, Jay Shah

On Blackwell, normalization and operand movement can limit attention kernels whose matrix multiplications are already deeply pipelined. We implement an FA4-style pipeline in Triton…