5 citations · 5 across the 6 of their papers we have counts for
3 papers · 1 filter
SR-OPSD: Self-Referenced On-Policy Self-Distillation
Zhuo Sun, Entong Li, Yanlong Zhao +9
On-policy self-distillation (OPSD) converts feedback into dense token-level supervision on student-generated trajectories, complementing reinforcement learning with sparse outcome…
Quantizing Time-Series Models As Dynamical Systems: Trajectory-Based Quantization Sensitivity Score
Mariya Pavlova, Harrison Bo Hua Zhu, Lidia Vitanova +2
We introduce the Trajectory-based Quantization Sensitivity Score (TQS), a metric that reframes post-training quantization (PTQ) through the lens of dynamical-systems stability. By…
Saliency-Aware Regularized Quantization Calibration for Large Language Models
Yanlong Zhao, Xiaoyuan Cheng, Huihang Liu +6
Post-training quantization (PTQ) is an effective approach for deploying large language models (LLMs) under memory and latency constraints. Most existing PTQ methods determine quant…