Is a Linear Probe Evidence of a Linear Representation?

Nadir Kutluozen, Christian Internò, David Klindt

The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a standard meth…