Counterfactual Tests for Measuring Chain-of-Thought Faithfulness in Visual Language Models

Bayar Menzat, Maximilian Süss, Ruizhi Wang +3

Chain-of-thought (CoT) may often look plausible, yet it may not faithfully reflect the model's decision-making process. While methods for measuring the faithfulness of CoTs for tex…