When Does Multi-Agent RL Improve LLM Workflows? Workflow, Scale, and Policy-Sharing Tradeoffs

Yifan Zeng, Yiran Wu, Yaolun Zhang +4

Outcome-reward RL can train every role of a multi-agent LLM workflow. Its benefit is hard to predict because the reward assigns no credit to individual roles and a shared policy tr…