2 papers
cs.LG2026
SR-OPSD: Self-Referenced On-Policy Self-Distillation
Zhuo Sun, Entong Li, Yanlong Zhao +9
On-policy self-distillation (OPSD) converts feedback into dense token-level supervision on student-generated trajectories, complementing reinforcement learning with sparse outcome…
cs.AI2026
Saliency-Aware Regularized Quantization Calibration for Large Language Models
Yanlong Zhao, Xiaoyuan Cheng, Huihang Liu +6
Post-training quantization (PTQ) is an effective approach for deploying large language models (LLMs) under memory and latency constraints. Most existing PTQ methods determine quant…