A Theoretical Interpretation of In-Context Learning via Probabilistic Modeling

Zhenyu Liu, Huaze Tang, Shao-Lun Huang

In-context learning (ICL) is an emerging paradigm that employs the semantic information inherent in large language models (LLMs) for generating answers to user queries. While the r…