3 papers
cs.AI2026
Failure Modes in Multi-Hop QA: The Weakest Link Effect and the Recognition Bottleneck
Meiru Zhang, Zaiqiao Meng, Nigel Collier
Despite scaling to massive context windows, Large Language Models (LLMs) struggle with multi-hop reasoning due to inherent position bias, which causes them to overlook information…
cs.CL2025
Time to Revist Exact Match
Auss Abbood, Zaiqiao Meng, Nigel Collier
Temporal question answering is an established method for evaluating temporal reasoning in large language models. Expected answers are often numeric (e.g., dates or durations), yet…
cs.CL2024
Attention Instruction: Amplifying Attention in the Middle via Prompting
Meiru Zhang, Zaiqiao Meng, Nigel Collier
The context window of large language models has been extended to 128k tokens or more. However, language models still suffer from position bias and have difficulty in accessing and…