3 citations · 5 across the 6 of their papers we have counts for
1 paper · 1 filter
Martí Llopart Font, Javier Hernando, Cristina España-Bonet
The standard FlashAttention-3 heuristic exhibits a GPU occupancy bottleneck in low-head-count decoding configurations because it disables sequence splitting based on sequence lengt…