1 citations · 1 across the 6 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
math.ST2026
Prediction-Only Distillation in Linear and Logistic Regression
Hien Dang, Pratik Patil, Alessandro Rinaldo
Self-distillation (SD) is typically studied when the student is retrained on the teacher's original training inputs. In many practical deployments, however, the labeled training da…
math.PR2026
Berry-Esseen bounds for multivariate martingale difference sequences in the Kolmogorov distance
Weichen Wu, Dung Le, Arun Kumar Kuchibhotla +1
We derive new Gaussian approximations for finite martingale difference sequences in with respect to the Kolmogorov distance. Under appropriate conditions, our bounds…
math.ST2026
Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning
Hien Dang, Pratik Patil, Alessandro Rinaldo
Self-distillation (SD) is the process of retraining a student on a mixture of ground-truth labels and the teacher's own predictions using the same architecture and training data. A…