Training Continuous Chain of Thought Models: A Tale of Two Regimes

Varun Yerram, He He, Eunsol Choi

Continuous Chain-of-Thought methods replace verbose reasoning traces with a short sequence of dense latent representations. Earlier continuous CoT methods indirectly supervise the…