Dale meets Langevin: A Multiplicative Denoising Diffusion Model

Nishanth Shetty, Madhava Prasath, Chandra Sekhar Seelamantula

Exponentiated gradient descent (EGD), a biologically motivated optimisation algorithm that respects Dale's law, produces log-normally distributed synaptic weights at convergence, i…