Fine-tune Language Models to Approximate Unbiased In-context Learning

Timothy Chu, Zhao Song, Chiwun Yang

In-context learning (ICL) is an astonishing emergent ability of large language models (LLMs). By presenting a prompt that includes multiple input-output pairs as examples and intro…