MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models

Xuanming Cui, Shlok Kumar Mishra, Wentao Bao +6

Universal multimodal embedding (UME) increasingly demands encoder's capacity for handling a broad range of tasks and modalities with increased complexity. Prior scaling methods eit…