4 papers · 1 filter
DeFA: Dependency-Guided Failure Attribution for LLM Agents
Bo Deng, Xinlei Zheng, Yi Wei +6
Errors in LLM agent executions and their visible consequences can be separated by many steps, making decisive-error localization a matter of understanding both step content and ste…
TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models
Yidong Wang, Yan Zhan, Ziteng Feng +16
Reward models are a bottleneck for reinforcement learning in embodied AI. Long-horizon robotic manipulation requires scalable vision feedback beyond handcrafted rewards or task-spe…
FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows
Bo Deng, Kang Zhou, Lifan Guo +6
Agents used over time encounter recurring professional work: each case requires different evidence and judgment, while the underlying workflow can be reused. Benchmarks built from…
DVD: A Robust Method for Detecting Variant Contamination in Large Language Model Evaluation
Renzhao Liang, Jingru Chen, Bo Jia +7
Evaluating large language models (LLMs) is increasingly confounded by \emph{variant contamination}: the training corpus contains semantically equivalent yet lexically or syntactica…