2 citations · 3 across the 6 of their papers we have counts for
1 paper · 2 filters
Gabriel Mongaras, Trevor Dohm, Eric C. Larson
Attention mechanisms, particularly softmax attention, have been instrumental in the success of transformer-based models such as GPT. However, the quadratic memory complexity of sof…