Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Temporal Dependencies in In-Context Learning: The Role of Induction Heads
Anooshka Bajaj, Deven Mahesh Mistry, Sahaj Singh Maini +3
Large language models (LLMs) exhibit strong in-context learning capabilities, but how they track and retrieve information from context remains underexplored. Drawing on the free re…
cs.CL2025
Gradual Forgetting: Logarithmic Compression for Extending Transformer Context Windows
Billy Dickson, Zoran Tiganj
Most approaches to long-context processing increase the complexity of the transformer's internal architecture by integrating mechanisms such as recurrence or auxiliary memory modul…