Understanding In-Context Learning from Repetitions

Jianhao Yan, Jin Xu, Chiyu Song +3

This paper explores the elusive mechanism underpinning in-context learning in Large Language Models (LLMs). Our work provides a novel perspective by examining in-context learning v…