832 citations · 1.3k across the 79 of their papers we have counts for
4 papers · 1 filter
On the number of response regions of deep feed forward networks with piece-wise linear activations
Razvan Pascanu, Guido Montufar, Yoshua Bengio
This paper explores the complexity of deep feedforward networks with linear pre-synaptic couplings and rectified linear activations. This is a contribution to the growing body of w…
Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units
Guido F. Montúfar
We generalize recent theoretical work on the minimal number of layers of narrow deep belief networks that can approximate any probability distribution on the states of their visibl…
Maximal Information Divergence from Statistical Models defined by Neural Networks
Guido Montufar, Johannes Rauh, Nihat Ay
We review recent results about the maximal values of the Kullback-Leibler information divergence from statistical models defined by neural networks, including naive Bayes models, r…
Discrete Restricted Boltzmann Machines
Guido Montufar, Jason Morton
We describe discrete restricted Boltzmann machines: probabilistic graphical models with bipartite interactions between visible and hidden discrete variables. Examples are binary re…