Why Knowing Both Hops Is Not Enough: Understanding Two-Hop Generalization in Language Models

Zili Zhang, Yilin Wang, Heng Wang +2

Large language models (LLMs) can solve complex multi-hop problems yet exhibit puzzling failures on simple two-hop queries: although a model may correctly store each individual hop,…