7 papers
The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression
Kevin Han Huang, Haoyu Ye, Somak Laha +1
Over-parameterized linear regression has been widely studied over the last decade. However, most existing works assume that the covariates are independent and that their covariance…
Universality of High-Dimensional Logistic Regression and a Novel CGMT under Dependence with Applications to Data Augmentation
Matthew Esmaili Mallory, Kevin Han Huang, Morgane Austern
Over the last decade, a wave of research has characterized the exact asymptotic risk of many high-dimensional models in the proportional regime. Two foundational results have drive…
Top Singular Value in Sum-Products of Random Matrices
Kevin Han Huang, Boris Hanin
We study the top singular value for a sum of independent random matrices, each of which is a product of i.i.d. Gaussian matrices. Our main conceptu…
Data augmented bootstrap: Unifying confidence interval construction by approximate invariance
Kevin Han Huang
We propose the data augmented bootstrap (DAB), a framework for constructing confidence intervals from approximately invariant transformations of the data. As special cases, DAB rec…
Gaussian universality for approximately polynomial functions of high-dimensional data
Kevin Han Huang, Morgane Austern, Peter Orbanz
Gaussian universality results assert that the properties of many estimators remain unchanged when the input data are replaced by Gaussians. Such results have gained popularity in h…
Gaussian and Non-Gaussian Universality of Data Augmentation
Kevin Han Huang, Peter Orbanz, Morgane Austern
We provide universality results that quantify how data augmentation affects the variance and limiting distribution of estimates through simple surrogates, and analyze several speci…