3 papers
math.NA2026
Kernel-based linear system identification using augmented Krylov subspaces
Fabio Matti, Martin Skovgaard Andersen, Tianshi Chen +1
We propose a novel Krylov subspace method for estimating the finite impulse response (FIR) of a one-dimensional linear time-invariant systems. The method approximates the system's…
math.NA2026
Attention Mechanisms Through the Lens of Numerical Methods: Approximation Methods and Alternative Formulations
Michel Fabrice Serret, Alice Cortinovis, Yijun Dong +10
The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale i…
math.NA2026
Stochastic trace estimation for parameter-dependent matrices applied to spectral density approximation
Fabio Matti, Haoze He, Daniel Kressner +1
Stochastic trace estimation is a well-established tool for approximating the trace of a large symmetric matrix . Several applications involve a matrix that depends…