5 papers
Hybrid Reasoning Agents
Jiaru Zou, Yunzhe Qi, Sirui Chen +5
How can we build an agent that thinks beyond human language, yet still acts through it in the external environment? Modern LLM agents still reason and interact through text, while…
Relic: From Multi-Agent Collaboration to Persistent Organizational Capability
Hongyi Du, Tianyi Zhang, Weijia Zhang +9
Multiple agents may often conflict in an organization: for example, one coding agent changes an interface in a repository, but another continues to develop on the old version where…
Automated Benchmark Auditing for AI Agents and Large Language Models
Junlin Wang, Federico Bianchi, Shang Zhu +4
Modern AI benchmarks operate at a complexity that outpaces traditional verification methods. Tasks authored by domain experts often contain implicit assumptions, incomplete environ…
DSGym: A Holistic Framework for Evaluating and Training Data Science Agents
Fan Nie, Junlin Wang, Harper Hua +6
Data science agents promise to accelerate discovery and insight-generation by turning data into executable analyses and findings. Yet existing data science benchmarks fall short du…
ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning
Yongchan Kwon, Shang Zhu, Federico Bianchi +2
The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in…