4 citations · 4 across the 6 of their papers we have counts for
7 papers
An exact information theory of generalization phase transitions in Bayesian diffusion models
Henry Hunt, Mason Kamb, Surya Ganguli
How diffusion models circumvent the curse of dimensionality to learn complex distributions over high dimensional spaces from a finite training set, instead of memorizing it, remain…
There Will Be a Scientific Theory of Deep Learning
Jamie Simon, Daniel Kunin, Alexander Atanasov +11
In this paper, we make the case that a scientific theory of deep learning is emerging. By this we mean a theory which characterizes important properties and statistics of the train…
CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers
Haining Pan, James V. Roggeveen, Erez Berg +16
Large language models (LLMs) have shown remarkable progress in coding and math problem-solving, but evaluation on advanced research-level problems in hard sciences remains scarce.…
An analytic theory of creativity in convolutional diffusion models
Mason Kamb, Surya Ganguli
We obtain an analytic, interpretable and predictive theory of creativity in convolutional diffusion models. Indeed, score-matching diffusion models can generate highly original ima…
Statistical topology of the streamlines of a two-dimensional flow
M. Kamb, J. Byrum, G. Huber +4
Recent experiments on mucociliary clearance, an important defense against airborne pathogens, have raised questions about the topology of two-dimensional (2D) flows. We introduce a…
The Anthropocene by the Numbers: A Quantitative Snapshot of Humanity's Influence on the Planet
Griffin Chure, Rachel A. Banks, Avi I. Flamholz +6
The presence and action of humans on Earth has exerted a strong influence on the evolution of the planet over the past 10,000 years, the consequences of which are now bec…
Time-Delay Observables for Koopman: Theory and Applications
Mason Kamb, Eurika Kaiser, Steven L. Brunton +1
Nonlinear dynamical systems are ubiquitous in science and engineering, yet analysis and prediction of these systems remains a challenge. Koopman operator theory circumvents some of…