${\ell }_1$-penalized Multinomial Regression: Estimation, inference, and prediction, with an application to risk factor identification for different dementia subtypes

Abstract

High-dimensional multinomial regression models are very useful in practice but have received less research attention than logistic regression models, especially from the perspective of statistical inference. In this work, we analyze the estimation and prediction error of the contrast-based ${\ell }_1$-penalized multinomial regression model and extend the debiasing method to the multinomial case, providing a valid confidence interval for each coefficient and $p$-value of the individual hypothesis test. We also examine cases of model misspecification and non-identically distributed data to demonstrate the robustness of our method when some assumptions are violated. We apply the debiasing method to identify important predictors in the progression into dementia of different subtypes. Results from extensive simulations show the superiority of the debiasing method compared to other inference methods.

48 pages, 5 figures, 44 tables

References in corpus (14)

• Nearly unbiased variable selection under minimax concave penalty
• High-dimensional graphs and variable selection with the Lasso
• Message Passing Algorithms for Compressed Sensing
• On asymptotically optimal confidence regions and tests for high-dimensional models
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Exact post-selection inference, with application to the lasso
• High-dimensional variable selection
• Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima
• A typical reconstruction limit of compressed sensing based on Lp-norm minimization
• Rates of convergence of the Adaptive LASSO estimators to the Oracle distribution and higher order refinements by the bootstrap
• Restricted Eigenvalue Conditions on Subgaussian Random Matrices
• High-dimensional Linear Regression for Dependent Data with Applications to Nowcasting
• Inference for the Case Probability in High-dimensional Logistic Regression
• Statistical Inference for Genetic Relatedness Based on High-Dimensional Logistic Regression