Activation Functions, Statistics and Learning of Higher-Order Interactions in Restricted Boltzmann Machines

Giovanni di Sarra, Yasser Roudi

The great success of neural networks primarily arises from the presence of the large number of weight parameters combined with nonlinearities in the input-output relationship of si…