On the Powerball Method for Optimization

Ye Yuan, Mu Li, Jun Liu +1

We propose a new method to accelerate the convergence of optimization algorithms. This method simply adds a power coefficient $\gamma \in [0,1)$ to the gradient during optimization. We ca…