2 papers
cs.LG2025
In-Context Learning of Linear Dynamical Systems with Transformers: Approximation Bounds and Depth-Separation
Frank Cole, Yuxuan Zhao, Yulong Lu +1
This paper investigates approximation-theoretic aspects of the in-context learning capability of the transformers in representing a family of noisy linear dynamical systems. Our fi…
cs.LG2025
In-Context Learning of Linear Systems: Generalization Theory and Applications to Operator Learning
Frank Cole, Yulong Lu, Wuzhe Xu +1
We study theoretical guarantees for solving linear systems in-context using a linear transformer architecture. For in-domain generalization, we provide neural scaling laws that bou…