Thermodynamic Irreversibility of Training Algorithms

Liu Ziyin, Yuanjie Ren, Adam Levine +1

The training algorithms for AI systems all introduce far-from-equilibrium dynamical processes, and understanding the irreversibility of these algorithms is a fundamental step towar…