1 citations · 1 across the 2 of their papers we have counts for
3 papers
The Attention Within: Consensus Dynamics in Selective State Space Models
João Pedro Silvestre, Álvaro Rodríguez Abella, Paulo Tabuada
Selective state space models (SSMs) have recently emerged as a compelling alternative to transformers, combining competitive performance with substantially improved inference effic…
The Asymptotic Behavior of Attention in Transformers
Álvaro Rodríguez Abella, João Pedro Silvestre, Paulo Tabuada
The transformer architecture has become the foundation of modern Large Language Models (LLMs), yet its theoretical properties are still not well understood. As with classic neural…
A Framework for Time-Varying Optimization via Derivative Estimation
Matteo Marchi, Jonathan Bunton, João Pedro Silvestre +1
Optimization algorithms have a rich and fundamental relationship with ordinary differential equations given by its continuous-time limit. When the cost function varies with time --…