3 papers
cs.LG2024
Learning Associative Memories with Gradient Descent
Vivien Cabannes, Berfin Simsek, Alberto Bietti
This work focuses on the training dynamics of one associative memory module storing outer products of token embeddings. We reduce this problem to the study of a system of particles…
cond-mat.dis-nn2023
Statistical physics, Bayesian inference and neural information processing
Erin Grant, Sandra Nestler, Berfin Şimşek +1
Lecture notes from the course given by Professor Sara A. Solla at the Les Houches summer school on "Statistical physics of Machine Learning". The notes discuss neural information p…
cs.LG2023
MLPGradientFlow: going with the flow of multilayer perceptrons (and finding minima fast and accurately)
Johanni Brea, Flavio Martinelli, Berfin Şimşek +1
MLPGradientFlow is a software package to solve numerically the gradient flow differential equation , where are the parameters of a mu…