14 papers
Cowork-Gym: Synthesizing Interactive Work Environments at Scale
Anni Zou, Cheng Chen, Jiaji Deng +18
Cowork agents navigate dependencies across tools and files while adapting to changing user requirements and edits to shared workspaces. Scaling such environments requires maintaini…
Playing social deduction games with reinforcement fine-tuned large language models
Lingzhe Zhang, Yunpeng Zhai, Tong Jia +7
Reinforcement fine-tuning (RFT) is increasingly used in applications where large language models (LLMs) interact with humans and other agents. Here we use social deduction games to…
AgentJet: A Distributed Swarm Training Framework for Agentic Reinforcement Learning
Qingxu Fu, Boyin Liu, Shuchang Tao +5
Training reinforcement learning (RL) policies for large language model (LLM) agents requires optimizing multi-turn trajectories that interact with external environments. Existing t…
RLCSD: Reinforcement Learning with Contrastive On-Policy Self-Distillation
Leyi Pan, Shuchang Tao, Yunpeng Zhai +5
On-policy self-distillation (OPSD) provides dense, token-level supervision for reasoning models by aligning a model's own distribution with that under privileged context, typically…
E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuning
Lingzhe Zhang, Yunpeng Zhai, Tong Jia +5
Contemporary microservice systems continue to grow in scale and complexity, leading to increasingly frequent and costly failures. While recent LLM-based auto-remediation approaches…
SeeUPO: Sequence-Level Agentic-RL with Convergence Guarantees
Tianyi Hu, Qingxu Fu, Yanxi Chen +2
Reinforcement learning (RL) has emerged as the predominant paradigm for training large language model (LLM)-based AI agents. However, existing backbone RL algorithms lack verified…
CuES: A Curiosity-driven and Environment-grounded Synthesis Framework for Agentic RL
Shinji Mai, Yunpeng Zhai, Ziqian Chen +5
Large language model based agents are increasingly deployed in complex, tool augmented environments. While reinforcement learning provides a principled mechanism for such agents to…
Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
Zouying Cao, Jiaji Deng, Li Yu +4
Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predom…
d-TreeRPO: Towards More Reliable Policy Optimization for Diffusion Language Models
Leyi Pan, Shuchang Tao, Yunpeng Zhai +8
Reinforcement learning (RL) is pivotal for enhancing the reasoning capabilities of diffusion large language models (dLLMs). However, existing dLLM policy optimization methods suffe…
AgentEvolver: Towards Efficient Self-Evolving Agent System
Yunpeng Zhai, Shuchang Tao, Cheng Chen +10
Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in d…
MicroRemed: Benchmarking LLMs in Microservices Remediation
Lingzhe Zhang, Yunpeng Zhai, Tong Jia +6
Large Language Models (LLMs) integrated with agent-based reasoning frameworks have recently shown strong potential for autonomous decision-making and system-level operations. One p…
Auto-Rubric: Learning From Implicit Weights to Explicit Rubrics for Reward Modeling
Lipeng Xie, Sen Huang, Zhuo Zhang +9
Conventional reward modeling relies on gradient descent over neural weights, creating opaque, data-hungry "black boxes." We propose a paradigm shift from implicit to explicit rewar…
Voting with the Graph: Stable RLAIF via Topological Consistency Maximization
Boyin Liu, Zhuo Zhang, Sen Huang +8
Reinforcement Learning from AI Feedback (RLAIF) relies on LLM judges as preference measurement instruments, yet these instruments are fundamentally limited by random measurement er…
Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models
Leyi Pan, Zheyu Fu, Yunpeng Zhai +9
Omni-modal Large Language Models (OLLMs) that integrate visual, auditory, and textual processing face severe safety risks. They exhibit fragile defenses against audio-visual joint…