2 papers
cs.LG2026
Putting Transformer Theories to the Test
Awni Altabaa, Tobias Schnabel, Kiran Tomlinson
Several formal theories have been developed to characterize the capabilities and limitations of the transformer architecture, each employing different abstractions that capture dif…
cs.LG2026
Uncovering Latent Reasoning Strategies in Language Models
Awni Altabaa, John Lafferty
A language model trained on reasoning tasks learns to solve problems via multiple distinct strategies, yet these strategies are implicit and entangled within the mo…