6 papers
From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMs
Jiawei Qiu, Yichen Xu, Jianzhe Ma +5
Timely anticipation of physical hazards is essential for real-world safety, yet existing MLLM evaluations focus on harmful content or general risks, leaving proactive physical haza…
A Survey of Deep Learning for Geometry Problem Solving
Jianzhe Ma, Wenxuan Wang, Qin Jin
Geometry problem solving, a crucial aspect of mathematical reasoning, is vital across various domains, including education, the assessment of AI's mathematical abilities, and multi…
EgoEsportsQA: An Egocentric Video Benchmark for Perception and Reasoning in Esports
Jianzhe Ma, Zhonghao Cao, Shangkui Chen +3
While video large language models (Video-LLMs) excel in understanding slow-paced, real-world egocentric videos, their capabilities in high-velocity, information-dense virtual envir…
RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees
Yichen Xu, Yuanhang Liu, Chuhan Wang +5
While Multimodal Large Language Models (MLLMs) excel at generic video understanding, their ability to support specialized, rule-grounded decision-making remains insufficiently expl…
POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
Yichen Xu, Liangyu Chen, Liang Zhang +3
Charts are a universally adopted medium for data communication, yet existing chart understanding benchmarks are overwhelmingly English-centric, limiting their accessibility and rel…
ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
Liangyu Chen, Yichen Xu, Jianzhe Ma +5
Chart editing reduces manual effort in visualization design. Typical benchmarks limited in data diversity and assume access to complete chart code, which is seldom in real-world sc…