A Principled Bayesian Framework for Training Binary and Spiking Neural Networks

James A. Walker, Moein Khajehnejad, Adeel Razi

We propose a Bayesian framework for training binary and spiking neural networks that achieves state-of-the-art performance without normalisation layers. Unlike commonly used surrog…