Lost in the Middle: An Emergent Property from Information Retrieval Demands in LLMs

Nikolaus Salvatore, Hao Wang, Qiong Zhang

The performance of Large Language Models (LLMs) often degrades when crucial information is in the middle of a long context, a "lost-in-the-middle" phenomenon that mirrors the prima…