1 citations · 2 across the 6 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Quasi Linear Kernel Attention with Infinite Capacity
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
The evaluation cost of transformers with softmax attention scales quadratically with sequence length. Kernel attention addresses this by replacing softmax with a more general kerne…
cs.LG2026
Fast Gauss Sums via Flash Attention
Nicolaj Rux, Sebastian Neumayer
Gaussian kernel sums are the computational core of maximum mean discrepancies (MMDs), kernel gradient flows, Stein variational gradient descent (SVGD), and many other kernel method…