Reasoning Models Know What's Important, and Encode It in Their Activations

Yaniv Nikankin, Martin Tutek, Tomer Ashuach +2

Language models often solve complex tasks by generating long reasoning chains, consisting of many steps with varying importance. While some steps are crucial for generating the fin…