8 papers · 1 filter
Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning
Pengyu Li, Zhitao Gao, Lingling Zhang +5
Unified multimodal models (UMMs) interleave generated ''visual thoughts'' (VTs) with text reasoning to improve spatial tasks. This incurs roughly an order-of-magnitude inference co…
ChartAct: A Benchmark for Dynamic Chart Understanding
Muye Huang, Lin Wu, Lingling Zhang +5
Charts are widely used to present complex data for analysis and decision making. Existing chart understanding benchmarks mainly focus on static charts, but real-world charts are of…
SketchVL: Policy Optimization via Fine-Grained Credit Assignment for Chart Understanding and More
Muye Huang, Lingling Zhang, Yifei Li +2
Charts are high-density visual carriers of complex data and medium for information extraction and analysis. Due to the need for precise and complex visual reasoning, automated char…
ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding
Muye Huang, Lingling Zhang, Jie Ma +6
Charts are high-density visualization carriers for complex data, serving as a crucial medium for information extraction and analysis. Automated chart understanding poses significan…
Diagram-Driven Course Questions Generation
Xinyu Zhang, Lingling Zhang, Yanrui Wu +6
Visual Question Generation (VQG) research focuses predominantly on natural images while neglecting the diagram, which is a critical component in educational materials. To meet the…
GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering
Lingling Zhang, Muye Huang, QianYing Wang +3
Chart Question Answering (CQA) aims at answering questions based on the visual chart content, which plays an important role in chart sumarization, business data analysis, and data…