2 citations · 2 across the 2 of their papers we have counts for
3 papers
cs.LG2026
Quasi Linear Kernel Attention with Infinite Capacity
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
The evaluation cost of transformers with softmax attention scales quadratically with sequence length. Kernel attention addresses this by replacing softmax with a more general kerne…
math.NA2025
Numerical Methods for Kernel Slicing
Nicolaj Rux, Johannes Hertrich, Sebastian Neumayer
Kernels are key in machine learning for modeling interactions. Unfortunately, brute-force computation of the related kernel sums scales quadratically with the number of samples. Re…
math.NA2024★ 2 cited
Fast Kernel Summation in High Dimensions via Slicing and Fourier Transforms
Johannes Hertrich
Kernel-based methods are heavily used in machine learning. However, they suffer from complexity in the number of considered data points. In this paper, we propose an a…