Stochastic Thermodynamics of Associative Memory

Spencer Rooke, Dmitry Krotov, Vijay Balasubramanian +1

Dense Associative Memory networks (DenseAMs) unify several popular paradigms in Artificial Intelligence (AI), such as Hopfield Networks, transformers, and diffusion models, while c…