POGD: Gradient Descent with New Stochastic Rules

Feihu Han, Sida Xing, Sui Yang Khoo

There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the…