2 citations · 9 across the 21 of their papers we have counts for
4 papers · 1 filter
Paint What You See: Benchmarking Dexterous Visual Tool Use in Multimodal Agents
Shudong Liu, Dongyang Chen, Enci Zhang +3
Evaluation is shifting from static QA toward agentic settings where models act through external tools. We identify a critical yet underexplored capability within this space - dexte…
AgentCompass: A Unified Evaluation Infrastructure for Agent Capabilities
Kai Chen, Zichen Ding, Jiaye Ge +20
As Large Language Models (LLMs) evolve into autonomous agents, the need for unified evaluation infrastructure becomes critical. However, current evaluation pipelines remain highly…
Expectation Alignment of Language Models for Real-World User Expectations
Miaomiao Li, Yang Wang, Bin Liang +3
Large language models (LLMs) have demonstrated remarkable performance on standard benchmarks, yet it remains largely unexplored whether they truly meet user expectations. Existing…
CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
Shudong Liu, Yiqiao Jin, Cheng Li +6
Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in p…