Representation Selection via Cross-Model Agreement using Canonical Correlation Analysis

Dylan B. Lewis, Jens Gregor, Hector Santos-Villalobos

Modern vision pipelines increasingly rely on pretrained image encoders whose representations are reused across tasks and models, yet these representations are often overcomplete an…