Dense Contexts Are Hard Contexts: Lexical Density Limits Effective Context in LLMs

Giovanni Dettori, Matteo Boffa, Danilo Giordano +2

Input length and the position of relevant information are widely cited as the primary causes of degraded LLM long-context performance. Here, we study lexical density -- the rate at…