What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis

Xinghao Chen, Chak Tou Leong, Wenjin Guo +3

Latent Chain-of-Thought (CoT) internalizes reasoning within continuous hidden states, offering a promising alternative to verbose discrete reasoning traces. However, robust latent…