Quantifying Structure in CLIP Embeddings: A Statistical Framework for Concept Interpretation

Jitian Zhao, Chenghui Li, Frederic Sala +1

Concept-based approaches, which aim to identify human-understandable concepts within a model's internal representations, are a promising method for interpreting embeddings from dee…