8 citations · 8 across the 4 of their papers we have counts for
4 papers
Phase structure of the Random Language Model
Alessio Giorlandino, Eric De Giuli, Sebastian Goldt
Context-free grammars are minimal models of hierarchical structure in human language, generating structured text from recursive production rules. The Random Language Model (RLM) [D…
Generalization Dynamics of Linear Diffusion Models
Claudia Merger, Sebastian Goldt
Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization wit…
Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation
Alessio Giorlandino, Sebastian Goldt
Finding the right initialisation for neural networks is crucial to ensure smooth training and good performance. In transformers, the wrong initialisation can lead to one of two fai…
Role of the potential landscape on the single-file diffusion through channels
S. D. Goldt, E. M. Terentjev
Transport of colloid particles through narrow channels is ubiquitous in cell biology as well as becoming increasingly important for microfluidic applications or targeted drug deliv…