4 papers
Beyond Structural Unification: A Perspective and Roadmap on Unified Multimodal Models
Yinyi Luo, Hayes Bai, Yiqiao Jin +5
Unified Multimodal Models (UMMs) emerge as a promising way to combine understanding and generation within a single architecture. We argue that current approaches mainly achieve str…
TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training
Yinyi Luo, Wenwen Wang, Hayes Bai +6
Recent advances in unified multimodal models (UMMs) have led to a proliferation of architectures capable of understanding, generating, and editing across visual and textual modalit…
LatentUMM: Dual Latent Alignment for Unified Multimodal Models
Yinyi Luo, Wenwen Wang, Hayes Bai +2
Unified multimodal models (UMMs) achieve strong performance in both understanding and generation by learning a shared latent space, yet they often exhibit functional inconsistency…
UniPath: Adaptive Coordination of Understanding and Generation for Unified Multimodal Reasoning
Hayes Bai, Yinyi Luo, Wenwen Wang +2
Unified multimodal models (UMMs) aim to integrate understanding and generation within a single architecture. However, it remains underexplored how to effectively coordinate these t…