4 papers
Kernel-based linear system identification using augmented Krylov subspaces
Fabio Matti, Martin Skovgaard Andersen, Tianshi Chen +1
We propose a novel Krylov subspace method for estimating the finite impulse response (FIR) of a one-dimensional linear time-invariant systems. The method approximates the system's…
Attention Mechanisms Through the Lens of Numerical Methods: Approximation Methods and Alternative Formulations
Michel Fabrice Serret, Alice Cortinovis, Yijun Dong +10
The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale i…
Stochastic trace estimation for parameter-dependent matrices applied to spectral density approximation
Fabio Matti, Haoze He, Daniel Kressner +1
Stochastic trace estimation is a well-established tool for approximating the trace of a large symmetric matrix . Several applications involve a matrix that depends…
A Click Ahead: Real-Time Forecasting of Keyboard and Mouse Actions using RNNs and Computer Vision
Fabio Matti, Pierre Dillenbourg, Ludovico Novelli
Computer input is more complex than a sequence of single mouse clicks and keyboard presses. We introduce a novel method to identify and represent the user interactions and build a…