Counterfactual Simulation Training for Chain-of-Thought Faithfulness

Peter Hase, Christopher Potts

Inspecting Chain-of-Thought reasoning is among the most common means of understanding why an LLM produced its output. But well-known problems with CoT faithfulness severely limit w…