4 papers · 1 filter
GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents
Xiao Zhou, Siyue Zhang, Yilun Zhao +4
Computer-use agents can execute software tasks through either graphical interfaces or programmatic command interfaces, but existing evaluations confound interaction modality with d…
From Brewing to Resolution: Tracing the Internal Lifecycle of Code Reasoning in LLMs
Siyue Chen, Yifu Guo, Yuquan Lu +9
Standard accuracy metrics cannot explain why LLMs handle variable tracking but fail on semantically equivalent loops. We study an internal lifecycle of code reasoning in which mode…
ReasonAudio: A Benchmark for Evaluating Reasoning Beyond Matching in Text-Audio Retrieval
Honglei Zhang, Yuting Chen, Chenpeng Hu +3
Existing audio retrieval benchmarks primarily assess semantic matching, lacking comprehensive evaluation of the logical reasoning capabilities required by complex queries. We intro…
Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agents
Yizhou Liu, Qi Sun, Yulin Chen +2
Agents equipped with search tools have emerged as effective solutions for knowledge-intensive tasks. While Large Language Models (LLMs) exhibit strong reasoning capabilities, their…