Gradient-based bilevel optimization for multi-penalty Ridge regression through matrix differential calculus

Gabriele Maroni, Loris Cannelli, Dario Piga

Common regularization algorithms for linear regression, such as LASSO and Ridge regression, rely on a regularization hyperparameter that balances the tradeoff between minimizing th…