Obtaining Lower Query Complexities through Lightweight Zeroth-Order Proximal Gradient Algorithms

Bin Gu, Xiyuan Wei, Hualin Zhang +2

Zeroth-order (ZO) optimization is one key technique for machine learning problems where gradient calculation is expensive or impossible. Several variance reduced ZO proximal algori…