Toward Native Multimodal Modeling: A Roadmap

Siyu An, Junru Lu, Junnan Dong +18

Multimodal modeling represents a vital step from modality-agnostic reasoning toward world modeling. While early approaches predominantly rely on late-fusion that assembles encoders…