Strategy Coopetition Explains the Emergence and Transience of In-Context Learning

Aaditya K. Singh, Ted Moskovitz, Sara Dragutinovic +3

In-context learning (ICL) is a powerful ability that emerges in transformer models, enabling them to learn from context without weight updates. Recent work has established emergent…