2 papers
cs.LG2026
SOLAR: A State-Driven Online Learning Rate Scheduler for LLM Pretraining
Qiulin Shang, Binyu Wang, Yongqi Qiao +3
Learning-rate (LR) scheduling plays a central role in large language model (LLM) pretraining, yet current practice still relies heavily on hand-crafted heuristics such as Warmup-Co…
cs.LG2026
On-policy Distillation with Verifiable Reward
Wenze Lin, Jiale Zhao, Xitai Jiang +5
Reinforcement Learning with Verifiable Rewards (RLVR) and on-policy distillation (OPD) have become two widely adopted paradigms for post-training large language models. However, RL…