353 citations · 1.3k across the 38 of their papers we have counts for
4 papers · 1 filter
Early Inference in Energy-Based Models Approximates Back-Propagation
Yoshua Bengio, Asja Fischer
We show that Langevin MCMC inference in an energy-based model with latent variables has the property that the early steps of inference, starting from a stationary point, correspond…
Population-Contrastive-Divergence: Does Consistency help with RBM training?
Oswin Krause, Asja Fischer, Christian Igel
Estimating the log-likelihood gradient with respect to the parameters of a Restricted Boltzmann Machine (RBM) typically requires sampling using Markov Chain Monte Carlo (MCMC) tech…
STDP as presynaptic activity times rate of change of postsynaptic activity
Yoshua Bengio, Thomas Mesnard, Asja Fischer +2
We introduce a weight update formula that is expressed only in terms of firing rates and their derivatives and that results in changes consistent with those associated with spike-t…
Bidirectional Helmholtz Machines
Jorg Bornschein, Samira Shabanian, Asja Fischer +1
Efficient unsupervised training and inference in deep generative models remains a challenging problem. One basic approach, called Helmholtz machine, involves training a top-down di…