3 papers
cs.CL2026
Temporal Dependencies in In-Context Learning: The Role of Induction Heads
Anooshka Bajaj, Deven Mahesh Mistry, Sahaj Singh Maini +3
Large language models (LLMs) exhibit strong in-context learning capabilities, but how they track and retrieve information from context remains underexplored. Drawing on the free re…
cs.CL2025
Gradual Forgetting: Logarithmic Compression for Extending Transformer Context Windows
Billy Dickson, Zoran Tiganj
Most approaches to long-context processing increase the complexity of the transformer's internal architecture by integrating mechanisms such as recurrence or auxiliary memory modul…
q-bio.NC2025
Vision-language models learn the geometry of human perceptual space
Craig Sanders, Billy Dickson, Sahaj Singh Maini +2
In cognitive science and AI, a longstanding question is whether machines learn representations that align with those of the human mind. While current models show promise, it remain…