Efficient Learning of Restricted Boltzmann Machines Using Covariance Estimates

Vidyadhar Upadhya, P. S. Sastry

Learning RBMs using standard algorithms such as CD(k) involves gradient descent on the negative log-likelihood. One of the terms in the gradient, which involves expectation w.r.t.…