6 papers · 2 filters
ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions
Guangxiang Zhao, Qilong Shi, Xusen Xiao +13
Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce \textsc{ScienceArena}, an olympiad-style benchmark from…
When Do Prompt-Side Agent Playbooks Transfer? Accuracy, Cost, and Runtime Shift in Agent Deployment
Weihong Lin, Lin Sun, Xiangzheng Zhang
Prompt-side playbooks can improve tool-using language agents without retraining, but their portability beyond the source setting is unclear. We study frozen playbook transfer under…
Harness-Bench: Evaluating Agent Harnesses across Models and Realistic Workflows
Yilun Yao, Xinyu Tan, Chao-Hsuan Liu +10
LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the…
MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection
Zhewen Tan, Yilun Yao, Huiyan Jin +9
Large language model agents increasingly rely on persistent memory to store past interactions, retrieve relevant demonstrations, and improve long-horizon task execution. However, t…
Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
Guangxiang Zhao, Qilong Shi, Xusen Xiao +3
Reasoning LLMs often spend substantial tokens on long intermediate reasoning traces (e.g., chain-of-thought) when solving new problems. We propose to summarize and store reusable r…
Beyond Parameter Arithmetic: Sparse Complementary Fusion for Distribution-Aware Model Merging
Weihong Lin, Lin Sun, Qilong Shi +6
Model merging has emerged as a promising paradigm for composing the capabilities of large language models by directly operating in weight space, enabling the integration of special…