Learning Regularizers: Learning Optimizers that can Regularize

Suraj Kumar Sahoo, Narayanan C Krishnan

Learned Optimizers (LOs), a type of Meta-learning, have gained traction due to their ability to be parameterized and trained for efficient optimization. Traditional gradient-based…