In-Context Learning of Linear Systems: Generalization Theory and Applications to Operator Learning

Frank Cole, Yulong Lu, Wuzhe Xu +1

We study theoretical guarantees for solving linear systems in-context using a linear transformer architecture. For in-domain generalization, we provide neural scaling laws that bou…