Showing 2026Show all
2 papers · 1 filter
math.NA2026
Kernel-based linear system identification using augmented Krylov subspaces
Fabio Matti, Martin Skovgaard Andersen, Tianshi Chen +1
We propose a novel Krylov subspace method for estimating the finite impulse response (FIR) of a one-dimensional linear time-invariant systems. The method approximates the system's…
math.NA2026
Attention Mechanisms Through the Lens of Numerical Methods: Approximation Methods and Alternative Formulations
Michel Fabrice Serret, Alice Cortinovis, Yijun Dong +10
The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale i…