Random Partitioning and Distribution-based Thresholding for Iterative Variable Screening in High Dimensions

Yu-Hsiang Cheng, Tzee-Ming Huang, Su-Yun Huang

In big data analysis, a simple task such as linear regression can become very challenging as the variable dimension $p$ grows. As a result, variable screening is inevitable in many…