How to Train Your Intercept: A Comparison of Intercept Update Strategies in Coordinate Descent

Johan Larsson, Frederik Fabricius-Bjerre

Coordinate descent solvers for regularized generalized linear models (GLMs) differ in how they update the intercept. This seemingly routine choice can substantially affect converge…