Rethinking UMM Visual Generation: Masked Modeling for Efficient Image-Only Pre-training

Peng Sun, Jun Xie, Tao Lin

Unified Multimodal Models (UMMs) are often constrained by the pre-training of their $\text{visual generation components}$, which typically relies on inefficient paradigms and sca…