7 papers
SR-OPSD: Self-Referenced On-Policy Self-Distillation
Zhuo Sun, Entong Li, Yanlong Zhao +9
On-policy self-distillation (OPSD) converts feedback into dense token-level supervision on student-generated trajectories, complementing reinforcement learning with sparse outcome…
Estimation of Directed Acyclic Graphs by Frequentist Model Averaging
Huihang Liu, Wenhui Li, Xinyu Zhang
Directed acyclic graphs provide a fundamental tool for representing directed dependence structures in multivariate network data, and are widely used to model financial and economic…
Saliency-Aware Regularized Quantization Calibration for Large Language Models
Yanlong Zhao, Xiaoyuan Cheng, Huihang Liu +6
Post-training quantization (PTQ) is an effective approach for deploying large language models (LLMs) under memory and latency constraints. Most existing PTQ methods determine quant…
Sufficiency-principled Transfer Learning via Model Averaging
Xiyuan Zhang, Huihang Liu, Xinyu Zhang
When the transferable set is unknowable, transfering informative knowledge as much as possible\textemdash a principle we refer to as \emph{sufficiency}, becomes crucial for enhanci…
Deep Generative Demand Learning for Newsvendor and Pricing
Shijin Gong, Huihang Liu, Xinyu Zhang
We consider data-driven inventory and pricing decisions in the feature-based newsvendor problem, where demand is influenced by both price and contextual features and is modeled wit…
Semi-supervised learning using copula-based regression and model averaging
Ziwen Gao, Huihang Liu, Xinyu Zhang
The available data in semi-supervised learning usually consists of relatively small sized labeled data and much larger sized unlabeled data. How to effectively exploit unlabeled da…
Representation Transfer Learning for Semiparametric Regression
Baihua He, Huihang Liu, Xinyu Zhang +1
We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of prima…