Efficient Omni-modal Large Language Model Inference via Per-Query Modality Selection

Shuqi Liu, Yuzhou Cao, Luke Ong

Omni-modal large language models (Omni-LLMs) can jointly process a broad range of modalities, such as text, audio, and video, enabling stronger multimodal understanding and reasoni…