Trust, but verify: benefits and pitfalls of least-squares refitting in high dimensions

Johannes Lederer

Least-squares refitting is widely used in high dimensional regression to reduce the prediction bias of l1-penalized estimators (e.g., Lasso and Square-Root Lasso). We present theor…