4 papers
FiGuRO: Intrinsic Dimension Estimation for Multi-Modal Data
Viktoria Schuster, Sana Tonekaboni, Caroline Uhler
Determining the complexity, or Intrinsic Dimension (ID), of data is fundamental to efficient and interpretable representation learning. This is particularly challenging in multi-mo…
MultiLoReFT: Decoupling Shared and Modality-Specific Subspaces in Multimodal Learning via Low-Rank Representation Fine-Tuning
Sana Tonekaboni, Viktoria Schuster, Caroline Uhler
Real-world perception and decision making are inherently multimodal, integrating complementary signals across modalities. However, training multimodal models faces two main obstacl…
Machine Learning for Health symposium 2024 -- Findings track
Stefan Hegselmann, Helen Zhou, Elizabeth Healey +6
A collection of the accepted Findings papers that were presented at the 4th Machine Learning for Health symposium (ML4H 2024), which was held on December 15-16, 2024, in Vancouver,…
An Information Criterion for Controlled Disentanglement of Multimodal Data
Chenyu Wang, Sharut Gupta, Xinyi Zhang +4
Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that i…