5 papers · 1 filter
SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specifications
Zhengxi Li, Junyi Zhou, Qiyuan Zhang +6
Evaluating an agent's ability to strictly satisfy diverse and procedurally complex requirements is essential to determining its practical reliability. Conducting such an evaluation…
WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitions
Junyi Zhou, Yufei Wang, Qiyuan Zhang +7
Developing terminal-based agents for long-horizon execution demands synthetic tasks that tightly couple complex instructions with authentic, interactive environments. However, curr…
Foundation Protocol: A Coordination Layer for Agentic Society
Bang Liu, Yongfeng Gu, Jiayi Zhang +26
Autonomous agents are moving from tools into a layer of social infrastructure: they browse, purchase, deploy software, manage systems, and increasingly interact with one another. A…
RubricBench: Aligning Model-Generated Rubrics with Human Standards
Qiyuan Zhang, Junyi Zhou, Yufei Wang +8
As Large Language Model (LLM) alignment evolves from simple completions to complex, highly sophisticated generation, Reward Models are increasingly shifting toward rubric-guided ev…
Beyond Length Scaling: Synergizing Breadth and Depth for Generative Reward Models
Qiyuan Zhang, Yufei Wang, Tianhe Wu +5
Recent advancements in Generative Reward Models (GRMs) have demonstrated that scaling the length of Chain-of-Thought (CoT) reasoning considerably enhances the reliability of evalua…