1.6k citations · 1.9k across the 32 of their papers we have counts for
1 paper · 1 filter
Jiawei Lin, Yuanlong Li, Guokai Chen +1
Transformer models rely heavily on the scaled dot-product attention (SDPA) operation, typically implemented as FlashAttention. Characterized by its frequent interleaving of matrix…