Mars-PO: Multi-Agent Reasoning System Preference Optimization

Xiaoxuan Lou, Chaojie Wang, Bo An

Mathematical reasoning is a fundamental capability for large language models (LLMs), yet achieving high performance in this domain remains a significant challenge. The auto-regress…