MoE Proxy Models for Low-Cost Failure Reproduction and Diagnosis in LLM RL Post-Training

Yikai Wang, Chuansai Zhou, Yuhang Zhou +10

Reinforcement learning (RL) post-training of large language models (LLMs) is computationally intensive and involves complex system pipelines with substantial debugging overhead. In…