2 papers
math.NA2026
High-order robust basis-update & Galerkin integrators for dynamical low-rank approximation
Cory D. Hauck, Jonas Kusch, Steffen Schotthöfer
Dynamical low-rank approximation has become a widely used numerical method in diverse disciplines. Its main idea is to represent the matrix or tensor-valued solution to a time-depe…
cs.LG2026
Tucker Attention: A generalization of approximate attention mechanisms
Timon Klein, Jonas Kusch, Sebastian Sager +2
The pursuit of reducing the memory footprint of the self-attention mechanism in multi-headed self attention (MHA) spawned a rich portfolio of methods, e.g., group-query attention (…