7 papers
VCap: Hypergeometric Rewards for Weak-to-Strong Visual Captioning
Xingyu Lu, Jinpeng Wang, Yi-Fan Zhang +13
Visual captioning requires models to capture visual content faithfully while minimizing both omission and hallucination. As the dominant paradigm for captioning, MLLMs have achieve…
ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchy
Xinkui Zhao, Sai Liu, Yifan Zhang +6
Large Language Model (LLM)-based multi-agent systems rely on optimized collaboration topologies to balance performance and communication costs. However, current methods struggle wi…
Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation
Wei Chen, Yancheng Long, Mingqiao Liu +9
While diffusion models have shown exceptional capabilities in aesthetic image synthesis, they often struggle with complex spatial understanding and reasoning. Existing approaches r…
Thyme: Think Beyond Images
Yi-Fan Zhang, Xingyu Lu, Shukang Yin +17
Following OpenAI's introduction of the ``thinking with images'' concept, recent efforts have explored stimulating the use of visual information in the reasoning process to enhance…
Why Distillation can Outperform Zero-RL: The Role of Flexible Reasoning
Xiao Hu, Xingyu Lu, Liyuan Mao +6
Reinforcement learning (RL) has played an important role in improving the reasoning ability of large language models (LLMs). Some studies apply RL directly to \textit{smaller} base…
VLM as Policy: Common-Law Content Moderation Framework for Short Video Platform
Xingyu Lu, Tianke Zhang, Chang Meng +14
Exponentially growing short video platforms (SVPs) face significant challenges in moderating content detrimental to users' mental health, particularly for minors. The dissemination…