Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
RL Starts before RL: On Policy Distillation for Better Reinforcement Learning
Shuai Dong, Yongfu Zhu, Yuqi Xu +26
Reinforcement learning (RL) improves reasoning, but its performance depends on the policy from which training begins. We study on-policy distillation (OPD) as a preparation stage f…
cs.LG2025
SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot
Kaiwen Tuo, Huan Wang
State-space language models such as Mamba match Transformer quality while permitting linear complexity inference, yet still comprise billions of parameters that hinder deployment.…