When does Chain-of-Thought Help: A Markovian Perspective

Zihan Wang, Yijun Dong, Qi Lei

Chain-of-Thought (CoT) prompting is a widely used inference-time technique for improving reasoning, yet its gains are uneven across tasks. We analyze when and why CoT helps by mode…