On the Geometry of Multimodal Saturation: Riemannian VICReg

Nessim Ben Abbes, Duc Han Le, Sabri Mtibaa +1

In self-supervised learning, a third modality should improve, or at least preserve, performance. Across nine image-text-tabular datasets, we show that it instead harms performance:…