New Insight of Variance reduce in Zero-Order Hard-Thresholding: Mitigating Gradient Error and Expansivity Contradictions

Xinzhe Yuan, William de Vazelhes, Bin Gu +1

Hard-thresholding is an important type of algorithm in machine learning that is used to solve ${\ell }_0$ constrained optimization problems. However, the true gradient of the objectiv…