Showing 2025Show all
3 papers · 1 filter
cs.LG2025
Eigenvalues as a Metric for Memory Dynamics in Sequence Models
Rahel Rickenbach, Jelena Trisovic, Alexandre Didier +2
While softmax attention drives state-of-the-art performance in sequence modeling, its quadratic complexity motivates linear alternatives such as state space models (SSMs). Structur…
eess.SY2025
Computationally Efficient System Level Tube-MPC for Uncertain Systems
Jerome Sieber, Alexandre Didier, Melanie N. Zeilinger
Tube-based model predictive control (MPC) is one of the principal robust control techniques for constrained linear systems affected by additive disturbances. While tube-based metho…
cs.LG2025
Lambda-Skip Connections: the architectural component that prevents Rank Collapse
Federico Arangath Joseph, Jerome Sieber, Melanie N. Zeilinger +1
Rank collapse, a phenomenon where embedding vectors in sequence models rapidly converge to a uniform token or equilibrium state, has recently gained attention in the deep learning…