Pigeonholing: how bad prompts hurt models, causing collapse and mistakes

Hyunji Nam, Keertana Chidambaram, Dorottya Demszky +1

While in-context learning is generally shown to be effective in Large Language Models (LLMs), bad contexts can cause performance degradation and mode collapse, a phenomenon we call…