On the Convergence of Stochastic Gradient Descent in Low-precision Number Formats

Matteo Cacciola, Antonio Frangioni, Masoud Asgharian +2

Deep learning models are dominating almost all artificial intelligence tasks such as vision, text, and speech processing. Stochastic Gradient Descent (SGD) is the main tool for tra…