2 papers
cs.LG2026
What Makes a Strong Model? A Unified Spectral Analysis of Knowledge Transfer over High-dimensional Linear Regression
Wendao Wu, Fangqing Zhang, Haihan Zhang +1
Teacher-Student Knowledge Transfer (KT) is ubiquitous in modern machine learning, ranging from classical model compression via Knowledge Distillation (KD) to the emergent phenomeno…
stat.ML2025
Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias
Honam Wong, Wendao Wu, Fanghui Liu +1
Recent advances in machine learning have inspired a surge of research into reconstructing specific quantities of interest from measurements that comply with certain physical laws.…