Bayesian Recurrent Units and the Forward-Backward Algorithm

Alexandre Bittar, Philip N. Garner

Using Bayes's theorem, we derive a unit-wise recurrence as well as a backward recursion similar to the forward-backward algorithm. The resulting Bayesian recurrent units can be int…