SHANG++: Robust Stochastic Acceleration under Multiplicative Noise

Yaxin Yu, Long Chen, Minfu Feng

Under the multiplicative noise scaling (MNS) condition, original Nesterov acceleration is provably sensitive to noise and may diverge when gradient noise overwhelms the signal. In…