Can Transformers Learn Sequential Function Classes In Context?

Ryan Campbell, Emma Guo, Evan Hu +2

In-context learning (ICL) has revolutionized the capabilities of transformer models in NLP. In our project, we extend the understanding of the mechanisms underpinning ICL by explor…