4 papers
Replication and Information Extraction in a Minimal Agent-Environment Model
Sebastiano Ariosto, Jerome Garnier-Brun, Luca Saglietti +1
How can information be extracted from data without explicit guidance or rewards? We investigate this question in a minimal setting where a classifying agent is exposed to a stream…
Biased Generalization in Diffusion Models
Jerome Garnier-Brun, Luca Biggio, Davide Beltrame +2
Generalization in generative modeling is defined as the ability to learn an underlying distribution from a finite dataset and produce novel samples, with evaluation largely driven…
Hydrodynamics of Cooperation and Self-Interest in a Two-Population Occupation Model
Jerome Garnier-Brun, Ruben Zakine, Michael Benzaquen
We study the hydrodynamics of a system of agents who optimize either their individual utility (self-interest) or the collective welfare (cooperation). When agents act selfishly, th…
How transformers learn structured data: insights from hierarchical filtering
Jerome Garnier-Brun, Marc Mézard, Emanuele Moscato +1
Understanding the learning process and the embedded computation in transformers is becoming a central goal for the development of interpretable AI. In the present study, we introdu…