37 citations · 64 across the 15 of their papers we have counts for
3 papers · 1 filter
Design Principles for Sequence Models via Coefficient Dynamics
Jerome Sieber, Antonio Orvieto, Melanie N. Zeilinger +1
Deep sequence models, ranging from Transformers and State Space Models (SSMs) to more recent approaches such as gated linear RNNs, fundamentally compute outputs as linear combinati…
Eigenvalues as a Metric for Memory Dynamics in Sequence Models
Rahel Rickenbach, Jelena Trisovic, Alexandre Didier +2
While softmax attention drives state-of-the-art performance in sequence modeling, its quadratic complexity motivates linear alternatives such as state space models (SSMs). Structur…
Stochastic MPC with Online-optimized Policies and Closed-loop Guarantees
Marcell Bartos, Alexandre Didier, Jerome Sieber +2
This paper proposes a stochastic model predictive control method for linear systems affected by additive Gaussian disturbances that optimizes over disturbance feedback matrices onl…