34 citations · 34 across the 3 of their papers we have counts for
1 paper · 1 filter
Michel Fabrice Serret, Laura Grigori
The bottleneck of attention mechanisms, which are the fundamental building block of modern language models, is their quadratic complexity in terms of context size. There has thus b…