2 papers
cs.LG2026
Phase Space Attention:A Hairer Lift Circumvents the Single-Layer Induction Obstruction
Kingsuk Maitra, Shagun Sood Morteza Hosseini, Suman Gunnala +1
We circumvent the Sanford-Hsu-Telgarsky (SHT) single-layer induction obstruction within a linear, one-step, causal, bilinear, symplectically consistent design class on the post-RoP…
cs.LG2026
Momentum Attention: The Physics of In-Context Learning and Spectral Forensics for Mechanistic Interpretability
Kingsuk Maitra
The Mechanistic Interpretability (MI) program has mapped the Transformer as a precise computational graph. We extend this graph with a conservation law and time-varying AC dynamics…