Adaptive Retrieval helps Reasoning in LLMs -- but mostly if it's not used

Srijan Shakya, Anamaria-Roberta Hartl, Sepp Hochreiter +1

Large Language Models (LLMs) often falter in complex reasoning tasks due to their static, parametric knowledge, leading to hallucinations and poor performance in specialized domain…