7 papers
Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
Dhaval C. Patel, Kaoutar El Maghraoui, Shuxin Lin +58
Agent benchmarks are growing fast, but no single benchmark touches more than four or five of the dimensions that deployment exposes. This paper aggregates the largest coordinated d…
LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories
Baochang Ren, Xinjie Liu, Xi Chen +15
Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach. AI can help read lit…
UnityMAS-O: A General RL Optimization Framework for LLM-Based Multi-Agent Systems
Yiqun Chen, Wei Yang, Erhan Zhang +14
LLM-based multi-agent systems decompose complex tasks into interacting roles, but most remain manually orchestrated by prompts, tools, and control rules, while agents are rarely op…
Towards Multi-Turn Dialog Systems for Industrial Asset Operations and Maintenance
Chengrui Li, Rujing Li, Yitong Bai +1
Industrial asset operations and maintenance question answering is inherently multi-turn, iterative, and highly dependent on external tool invocation. However, the conventional plan…
Select-then-Solve: Paradigm Routing as Inference-Time Optimization for LLM Agents
Heng Zhou, Zelin Tan, Zhemeng Zhang +15
When an LLM-based agent improves on a task, is the gain from the model itself or from the reasoning paradigm wrapped around it? We study this question by comparing six inference-ti…
CoEnv: Driving Embodied Multi-Agent Collaboration via Compositional Environment
Li Kang, Yutao Fan, Rui Li +11
Multi-agent embodied systems hold promise for complex collaborative manipulation, yet face critical challenges in spatial coordination, temporal reasoning, and shared workspace awa…