Surrogate Assisted Semi-supervised Inference for High Dimensional Risk Prediction

Abstract

Risk modeling with EHR data is challenging due to a lack of direct observations on the disease outcome, and the high dimensionality of the candidate predictors. In this paper, we develop a surrogate assisted semi-supervised-learning (SAS) approach to risk modeling with high dimensional predictors, leveraging a large unlabeled data on candidate predictors and surrogates of outcome, as well as a small labeled data with annotated outcomes. The SAS procedure borrows information from surrogates along with candidate predictors to impute the unobserved outcomes via a sparse working imputation model with moment conditions to achieve robustness against mis-specification in the imputation model and a one-step bias correction to enable interval estimation for the predicted risk. We demonstrate that the SAS procedure provides valid inference for the predicted risk derived from a high dimensional working model, even when the underlying risk prediction model is dense and the risk model is mis-specified. We present an extensive simulation study to demonstrate the superiority of our SSL approach compared to existing supervised methods. We apply the method to derive genetic risk prediction of type-2 diabetes mellitus using a EHR biobank cohort.

References in corpus (13)

• Simultaneous analysis of Lasso and Dantzig selector
• On the conditions used to prove oracle results for the Lasso
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Efficient and Adaptive Linear Regression in Semi-Supervised Settings
• Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models
• Significance testing in non-sparse high-dimensional linear models
• A unifying approach for doubly-robust ${\ell }_1$ regularized estimation of causal contrasts
• Robust and Efficient Semi-Supervised Estimation of Average Treatment Effects with Application to Electronic Health Records Data
• On the role of surrogates in the efficient estimation of treatment effects with limited outcome data
• Inference for the Case Probability in High-dimensional Logistic Regression
• High Dimensional M-Estimation with Missing Outcomes: A Semi-Parametric Framework
• Prior Adaptive Semi-supervised Learning with Application to EHR Phenotyping
• High-dimensional semi-supervised learning: in search for optimal inference of the mean

Cited by in corpus (2)

• Prediction De-Correlated Inference: A safe approach for post-prediction inference
• Efficient and Robust Semi-supervised Estimation of ATE with Partially Annotated Treatment and Response