Multiplicative learning from observation-prediction ratios

Han Kim, Hyungjoon Soh, Vipul Periwal +1

Additive parameter updates, as used in gradient descent and its adaptive extensions, underpin most modern machine-learning optimization. Yet, such additive schemes often demand num…