A Bayesian Approach to Recurrence in Neural Networks

Philip N. Garner, Sibo Tong

We begin by reiterating that common neural network activation functions have simple Bayesian origins. In this spirit, we go on to show that Bayes's theorem also implies a simple re…