When Does Perceptual Alignment Benefit Vision Representations?

Shobhita Sundaram, Stephanie Fu, Lukas Muttenthaler +5

Humans judge perceptual similarity according to diverse visual attributes, including scene layout, subject location, and camera pose. Existing vision models understand a wide range…