2 papers
cond-mat.stat-mech2025
Large language models and the entropy of English
Colin Scheibner, Lindsay M. Smith, William Bialek
We use large language models (LLMs) to uncover long-ranged structure in English texts from a variety of sources. The conditional entropy or code length in many cases continues to d…
physics.hist-ph2024
Moving boundaries: An appreciation of John Hopfield
William Bialek
The 2024 Nobel Prize in Physics was awarded to John Hopfield and Geoffrey Hinton, "for foundational discoveries and inventions that enable machine learning with artificial neural n…