Adam Induces Implicit Weight Sparsity in Rectifier Neural Networks

Atsushi Yaguchi, Taiji Suzuki, Wataru Asano +3

In recent years, deep neural networks (DNNs) have been applied to various machine leaning tasks, including image recognition, speech recognition, and machine translation. However,…