2 papers
stat.ML2022
MSTGD:A Memory Stochastic sTratified Gradient Descent Method with an Exponential Convergence Rate
Aixiang, Chen, Jinting Zhang +2
The fluctuation effect of gradient expectation and variance caused by parameter update between consecutive iterations is neglected or confusing by current mainstream gradient optim…
stat.ML2021
:An Unbiased Stratified Statistic and a Fast Gradient Optimization Algorithm Based on It
Aixiang Chen
-The fluctuation effect of gradient expectation and variance caused by parameter update between consecutive iterations is neglected or confusing by current mainstream gradient opti…