2 papers
cs.LG2025
Lost in the Middle: An Emergent Property from Information Retrieval Demands in LLMs
Nikolaus Salvatore, Hao Wang, Qiong Zhang
The performance of Large Language Models (LLMs) often degrades when crucial information is in the middle of a long context, a "lost-in-the-middle" phenomenon that mirrors the prima…
q-bio.NC2025
Sequence-to-Sequence Models with Attention Mechanistically Map to the Architecture of Human Memory Search
Nikolaus Salvatore, Qiong Zhang
Past work has long recognized the important role of context in guiding how humans search their memory. While context-based memory models can explain many memory phenomena, it remai…