What Makes a Good Visual Representation for Spatial Understanding in MLLMs?

Xiaohu Huang, Yumin Guo, Kai Han

Spatial understanding is a necessary step in moving multimodal large language models (MLLMs) toward reasoning about the 3D physical world. Their visual pretraining data, however, i…