Penalization-induced shrinking without rotation in high dimensional GLM regression: a cavity analysis

Emanuele Massa, Marianne Jonker, Anthony Coolen

In high dimensional regression, where the number of covariates is of the order of the number of observations, ridge penalization is often used as a remedy against overfitting. Unfo…