137 citations · 510 across the 88 of their papers we have counts for
32 papers · 1 filter
Riccati State Space Models: Non-iterative Parallelization for Nonlinear Sequence Modeling
Mónika Farsang, Ramin Hasani, Daniela Rus +1
State space models (SSMs) achieve efficient sequence processing because their affine state updates are closed under composition and can therefore be evaluated with an associative p…
Reshape and Recur: Improving SSMs with Input Reshaping and Depth Recurrence
Mónika Farsang, Ramin Hasani, Daniela Rus +1
State Space Models (SSMs) are increasingly deployed in the Edge because they offer, at comparable performance, a smaller memory/training/inference footprint, compared to Large Lang…
Towards Safe Learning-Based Non-Linear Model Predictive Control through Recurrent Neural Network Modeling
Mihaela-Larisa Clement, Mónika Farsang, Agnes Poks +4
The practical deployment of nonlinear model predictive control (NMPC) is often limited by online computation: solving a nonlinear program at high control rates can be expensive on…
Single molecule localization microscopy challenge: a biologically inspired benchmark for long-sequence modeling
Fatemeh Valeh, Monika Farsang, Radu Grosu +1
State space models (SSMs) have recently achieved strong performance on long sequence modeling tasks while offering improved memory and computational efficiency compared to transfor…
Relative Entropy Pathwise Policy Optimization
Claas Voelcker, Axel Brunnbauer, Marcel Hussing +6
Score-function based methods for policy learning, such as REINFORCE and PPO, have delivered strong results in game-playing and robotics, yet their high variance often undermines tr…
Differential Gated Self-Attention
Elpiniki Maria Lygizou, Mónika Farsang, Radu Grosu
Transformers excel across a large variety of tasks but remain susceptible to corrupted inputs, since standard self-attention treats all query-key interactions uniformly. Inspired b…