Learning Modal-Mixed Chain-of-Thought Reasoning with Latent Embeddings

Yifei Shao, Kun Zhou, Ziming Xu +5

We study how to extend chain-of-thought (CoT) beyond language to better handle multimodal reasoning. While CoT helps LLMs and VLMs articulate intermediate steps, its text-only form…