Larger language models do in-context learning differently

Jerry Wei, Jason Wei, Yi Tay +8

We study how in-context learning (ICL) in language models is affected by semantic priors versus input-label mappings. We investigate two setups-ICL with flipped labels and ICL with…