5 papers · 1 filter
Characterizing Finite-Dimensional Posterior Marginals in High-Dimensional GLMs via Leave-One-Out
Manuel Sáenz, Pragya Sur
We investigate Bayes posterior distributions in high-dimensional generalized linear models (GLMs) under the proportional asymptotics regime, where the number of features and sample…
Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling
Yufan Li, Pragya Sur
We study the fundamental problem of calibrating a linear binary classifier of the form , where the feature vector is Gaussian, is a link function, and $\…
ROTI-GCV: Generalized Cross-Validation for right-ROTationally Invariant Data
Kevin Luo, Yufan Li, Pragya Sur
Two key tasks in high-dimensional regularized regression are tuning the regularization strength for accurate predictions and estimating the out-of-sample risk. It is known that the…
Universality in block dependent linear models with applications to nonparametric regression
Samriddha Lahiry, Pragya Sur
Over the past decade, characterizing the exact asymptotic risk of regularized estimators in high-dimensional regression has emerged as a popular line of work. This literature consi…
Spectrum-Aware Debiasing: A Modern Inference Framework with Applications to Principal Components Regression
Yufan Li, Pragya Sur
Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it i…