2 citations · 2 across the 2 of their papers we have counts for
1 paper · 1 filter
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
The evaluation cost of transformers with softmax attention scales quadratically with sequence length. Kernel attention addresses this by replacing softmax with a more general kerne…