Adaptive Hierarchical Representation Alliance for Multimodal Learning

Chunlei Meng, Pengbin Feng, Jacqueline J. Pang +5

Multimodal models often align language, vision, and audio in a single final-layer latent space, implicitly assuming that task-relevant evidence emerges at the same semantic depth a…