2 papers
cs.CV2026
JavisGPT: A Unified Multi-modal LLM for Sounding-Video Comprehension and Generation
Kai Liu, Jungang Li, Yuchong Sun +13
This paper presents JavisGPT, the first unified multimodal large language model (MLLM) for joint audio-video (JAV) comprehension and generation. JavisGPT has a concise encoder-LLM-…
cs.MM2025
JointAVBench: A Benchmark for Joint Audio-Visual Reasoning Evaluation
Jianghan Chao, Jianzhang Gao, Wenhui Tan +3
Understanding videos inherently requires reasoning over both visual and auditory information. To properly evaluate Omni-Large Language Models (Omni-LLMs), which are capable of proc…