1 citations · 1 across the 5 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.LG2025
The Curved Spacetime of Transformer Architectures
Riccardo Di Sipio, Jairo Diaz-Rodriguez, Luis Serrano
We present a geometric framework for understanding Transformer-based language models, drawing an explicit analogy to General Relativity. Queries and keys induce an effective metric…
cs.CL2025
Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attention
Mumin Jia, Jairo Diaz-Rodriguez
Human cognition is punctuated by abrupt, spontaneous shifts between topics-driven by emotional, contextual, or associative cues-a phenomenon known as spontaneous thought in neurosc…