generative modeling 1optimal mixing 1rectified flow 1ridge regularization 1self-distillation 1velocity estimation 1
From the 1 of 5 linked papers with an AI index.
Showing math.STShow all
2 papers · 1 filter
math.ST2026
Prediction-Only Distillation in Linear and Logistic Regression
Hien Dang, Pratik Patil, Alessandro Rinaldo
Self-distillation (SD) is typically studied when the student is retrained on the teacher's original training inputs. In many practical deployments, however, the labeled training da…
math.ST2026
Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning
Hien Dang, Pratik Patil, Alessandro Rinaldo
Self-distillation (SD) is the process of retraining a student on a mixture of ground-truth labels and the teacher's own predictions using the same architecture and training data. A…