Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

Dominick Reilly, Qiyu Wu, Hiromi Wakaki +2

Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference. However, ma…