Omni-Modal LLMs Know More Than They Say

Na Min An, Taekyung Kim, Jaemyung Yu +2

Omni-modal large language models (Omni-LLMs) extend LLMs to process heterogeneous modalities (e.g., vision, audio, and IMU signals) alongside language, enabling a broader range of…