81 citations · 101 across the 5 of their papers we have counts for
5 papers · 1 filter
Everything in its right place: attention is a radio head
Lluís Arola-Fernández, Aissam Khadraoui, Alex Arenas
Attention, the core of language models, is a digital calculation over tokens: an exponential selects them, a division normalizes and a positional code sets the order. We show that…
Scalar embedding of temporal network trajectories
Lucas Lacasa, F. Javier Marín-Rodríguez, Naoki Masuda +1
A temporal network -- a collection of snapshots recording the evolution of a network whose links appear and disappear dynamically -- can be interpreted as a trajectory in graph spa…
Understanding following patterns among high-performance athletes
Jorge P. Rodríguez, Lluís Arola-Fernández
Professional sports enhance interaction among athletes through training groups, sponsored events and competitions. Among these, the Olympic Games represent the largest competition…
An effective theory of collective deep learning
Lluís Arola-Fernández, Lucas Lacasa
Unraveling the emergence of collective learning in systems of coupled artificial neural networks points to broader implications for machine learning, neuroscience, and society. Her…
Self-organized explosive synchronization in complex networks: Emergence of synchronization bombs
Lluís Arola-Fernández, Sergio Faci-Lázaro, Per Sebastian Skardal +3
We introduce the concept of synchronization bombs as large networks of coupled heterogeneous oscillators that operate in a bistable regime and abruptly transit from incoherence to…