RECAP: Calibrating Low-Bit Reasoning Models on the History They Read

Chi Ruan, Yujie Chen, Zixiang Zhao +2

Low-bit quantization reduces the cost of serving reasoning models but can substantially degrade long chains of thought. Each step reads cached keys and values spanning thousands of…