Log-Normal Multiplicative Dynamics for Stable Low-Precision Training of Large Networks

Keigo Nishida, Eren Mehmet Kıral, Kenichi Bannai +2

Studies in neuroscience have shown that biological synapses follow a log-normal distribution whose transitioning can be explained by noisy multiplicative dynamics. Biological netwo…