4 papers · 1 filter
Memorizing Who, Knowing How: Benchmarking Personal and Procedural Memory for Persistent Assistants
Maosheng Qin, Qi Zhang, Mingxuan Xia +5
Memory systems for persistent personal agents must move beyond isolated memories, maintaining both personal memory about whom they serve and procedural memory about how to act. Cru…
PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
Yuhang Yang, Mingxuan Xia, Chao Ye +6
On-policy self-distillation (OPSD) uses a self-teacher conditioned on privileged information to turn the sparse outcome signal of reinforcement learning with verifiable rewards (RL…
CriPO: Enhancing Rubric-based RL via Self-Distillation
Mingxuan Xia, Yuhang Yang, Chao Ye +8
Rubric-based Reinforcement Learning (RL) has recently shown promise in improving Large Language Models (LLMs) on open-ended tasks. A widely recognized limitation of rubric-based RL…
OPRD: On-Policy Representation Distillation
Shenzhi Yang, Guangcheng Zhu, Bowen Song +8
On-policy distillation (OPD) supervises the student exclusively in the output space by matching next-token distributions. This paradigm suffers from two limitations: (i) a high-var…