Gradient descent learning in and out of equilibrium

Nestor Caticha, Evaldo Araujo de Oliveira

Relations between the off thermal equilibrium dynamical process of on-line learning and the thermally equilibrated off-line learning are studied for potential gradient descent lear…