Targeted Retrieval, Compact Representations: How CoT Reasoning Improves Long-Context Counting

Liang Twist Shan, Tianyu Hu, Hao Yan +1

Large language models (LLMs) have been rapidly improving in long-context tasks, powered by Chain-of-Thought (CoT) reasoning. However, the internal mechanisms underlying this improv…