171 citations · 246 across the 15 of their papers we have counts for
3 papers · 1 filter
GASPnet: Global Agreement to Synchronize Phases
Andrea Alamia, Sabine Muzellec, Thomas Serre +1
In recent years, Transformer architectures have revolutionized most fields of artificial intelligence, relying on an attentional mechanism based on the agreement between keys and q…
Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models
Louis Béthune, David Vigouroux, Yilun Du +3
What is the shortest path between two data points lying in a high-dimensional space? While the answer is trivial in Euclidean geometry, it becomes significantly more complex when t…
Learning to Chain Operations by Routing Information Through a Global Workspace
Hugo Chateau-Laurent, Rufin VanRullen
We present a model inspired by the Global Workspace Theory that integrates specialized modules to perform a sequential reasoning task. A controller selectively routes information b…