Context Poisoning as Extreme-Value Attention Interference in Long-Context Language Models

Meysam Ghaffari, Nina Fatehi, Bhaskar Sen +2

Large language models can process increasingly long prompts, yet their ability to locate and use decisive evidence may degrade as irrelevant or confusable context is added. We form…