CAPO: Critic-Guided Action-Aligned Policy Optimization for Advancing LLM Agent Capabilities

Daoyu Wang, Qingchuan Li, Mingyue Cheng +6

Reinforcement learning (RL) has become a key technique for improving the agentic capabilities of large language models (LLMs). Although critic-free methods such as GRPO are increas…