3 papers
cs.LG2026
REOPD: Reliability-Adaptive Reward Extrapolation for On-Policy Distillation
Yang Sun, Lichao Ma, Houyuan Qin +5
On-policy distillation (OPD) trains a student on its own trajectories under dense token-level supervision from a teacher. Reward-extrapolation methods such as ExOPD amplify the tea…
cs.AI2026
Long SKILL Compliance as Logical Reasoning: Closure-Grounded Detection with Scaling-Guided On-Policy Distillation
Shuaitao Zhao, Feng Ni, Lichao Ma +4
The increasing complexity of enterprise business scenarios has promoted the widespread adoption of long SKILL documents in agent systems, posing new challenges for compliance detec…
cs.AI2026
How Much, Then Where: Credit-Conserving Action-to-Token Allocation for Multi-Turn Agent Reinforcement Learning
Lichao Ma, Yang Sun, Shuaitao Zhao +9
Credit assignment in multi-turn agent reinforcement learning operates at two levels: assigning trajectory-level credit to actions and distributing each action's credit across its t…