6 citations · 6 across the 6 of their papers we have counts for
4 papers · 1 filter
Prior-Fitted and Frozen Scorers for Multimodal Contrastive Learning
Tillmann Rheude, Roland Eils, Benjamin Wild
Multimodal contrastive learning typically relies on manually specified scoring functions, such as cosine similarity, to quantify the similarity between representations from differe…
Beyond Objective Expressivity: Geometry Preservation in Multimodal Contrastive Learning
Tillmann Rheude, Roland Eils, Benjamin Wild
Contrastive learning is increasingly moving toward settings with three or more modalities instead of image-text pairs. Yet, extending models from pairwise to higher-order multimoda…
Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI
Minh Duc Do, Tillmann Rheude, Noel Kronenberg +2
Brain MRI poses a fundamental challenge for machine learning: models must learn from high-dimensional 3D data spanning multiple co-registered modalities, despite the limited sample…
Hidden in the Multiplicative Interaction: Uncovering Fragility in Multimodal Contrastive Learning
Tillmann Rheude, Stefan Hegselmann, Roland Eils +1
Contrastive learning has become a standard approach for unsupervised learning from paired data, as demonstrated by CLIP for image-text matching. However, many domains involve more…