2 citations · 2 across the 11 of their papers we have counts for
1 paper · 2 filters
Praneeth Kacham, Vahab Mirrokni, Peilin Zhong
The quadratic time and memory complexity inherent to self-attention mechanisms, with respect to sequence length, presents a critical computational bottleneck in the training and de…