TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization

Xiang Li, Junchi Yang, Niao He

Adaptive gradient methods have shown their ability to adjust the stepsizes on the fly in a parameter-agnostic manner, and empirically achieve faster convergence for solving minimiz…