Uncovering Spontaneous Physics Representations in In-Context Learning

Yeongwoo Song, Jaeyong Bae, Dong-Kyum Kim +1

In-context learning (ICL) lets large language models (LLMs) solve new tasks from prompts alone, across an ever-widening range of domains, yet the mechanisms underlying this ability…