Decodability is Not Causality: Dissociating Probe Readouts from Behavioral Drivers via SAE Decomposition

Devesh Tiwari, Camille Davis, Shivank Sinha +3

Linear probes can decode safety-relevant concepts such as truthfulness from language-model activations, but probe accuracy may show only decodability, not that the features the pro…