16 citations · 38 across the 13 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.LG2019★ 16 cited
Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization
Kaiyi Ji, Zhe Wang, Yi Zhou +1
Two types of zeroth-order stochastic algorithms have recently been designed for nonconvex optimization respectively based on the first-order techniques SVRG and SARAH/SPIDER. This…
math.OC2019
History-Gradient Aided Batch Size Adaptation for Variance Reduced Algorithms
Kaiyi Ji, Zhe Wang, Bowen Weng +3
Variance-reduced algorithms, although achieve great theoretical performance, can run slowly in practice due to the periodic gradient estimation with a large batch of data. Batch-si…
math.OC2019★ 11 cited
Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization
Yi Zhou, Zhe Wang, Kaiyi Ji +2
Two new stochastic variance-reduced algorithms named SARAH and SPIDER have been recently proposed, and SPIDER has been shown to achieve a near-optimal gradient oracle complexity fo…