FedUMM: A General Framework for Federated Learning with Unified Multimodal Models

Zhaolong Su, Leheng Zhao, Xiaoying Wu +2

Unified multimodal models (UMMs) are emerging as strong foundation models that can do both generation and understanding tasks in a single architecture. However, they are typically…