Automatic Domain Adaptation by Transformers in In-Context Learning

Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and…