4 papers
Rotated, but How Far? Diagnosing and Improving Object-Rotation Reasoning in VLMs
Zhaochen Wang, Yujun Cai, Huangbo Zou +4
Vision-language models (VLMs) can detect that an object has rotated across views, but cannot reliably tell by how much. We introduce OR-Bench, a fine-grained benchmark for object-r…
AdaM-Rec: Adaptive Modality Routing for Multimodal Recommendation
Honghao Fu, Jiacheng Chen, Manxi Lin +7
While recent multimodal recommender systems have demonstrated the effectiveness of incorporating visual and textual information to improve downstream performance, most existing met…
V-DEAL: Diagnosing Video Safety De-Calibration as an Understanding-Refusal Coupling Failure
Zhetong Zhang, Honghao Fu, Miao Xu +2
As Video Large Language Models are increasingly deployed in real-world applications, ensuring their safety alignment has become critical. Counterintuitively, we find that harmful v…
VideoStir: Understanding Long Videos via Spatio-Temporally Structured and Intent-Aware RAG
Honghao Fu, Miao Xu, Yiwei Wang +3
Scaling multimodal large language models (MLLMs) to long videos is constrained by limited context windows. While retrieval-augmented generation (RAG) is a promising remedy by organ…