Best Subset Selection in Linear Regression: Fixed-Design Error Bounds and Insights for Random Designs

Maxim Fedotov

We study exact support recovery by best subset selection in linear regression under a fixed design. For a known support size $s$ and ambient dimension $d$, we derive a non-asymptot…