3 papers
cs.CL2026
Turning Off-Policy Tokens On-Policy: A Plug-in Approach for Improving LLM Alignment
Yu Li, Xiuyu Li, Mingyang Yi +5
Reinforcement learning (RL) post-training for large language models (LLMs) follows a efficient paradigm of "rollout then update", which inevitably results in off-policy training da…
cs.AI2026
Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning
Yu Li, Mingyang Yi, Xiuyu Li +6
Agentic Reinforcement Learning (ARL) trains large language models to interleave reasoning with external tool execution to solve complex tasks. Most existing ARL methods train a sin…
cs.LG2026
ETS: Energy-Guided Test-Time Scaling for Training-Free RL Alignment
Xiuyu Li, Jinkai Zhang, Mingyang Yi +4
Reinforcement Learning (RL) post-training alignment for language models is effective, but also costly and unstable in practice, owing to its complicated training process. To addres…