56 citations · 105 across the 11 of their papers we have counts for
12 papers
A theory of platonic representations in language models
Darshil Doshi, Wenjie Zhou, Corinna Elena Wegner +3
Representations of translated sentences are similar in the inner layers of multilingual language models -- an observation connected to the platonic representation hypothesis, yet u…
Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop?
Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis +1
Generative models have a persistent limitation: their tendency to memorize training data can create legal liabilities and erode creative diversity. Understanding which samples are…
Learn from your own latents and not from tokens: A sample-complexity theory
Daniel J. Korchinski, Alessandro Favero, Matthieu Wyart
Generative models, from diffusion models to large language models, achieve remarkable performance but at a cost in training data orders of magnitude larger than what biological lea…
Sampling Data with Chains of Forward-Backward Diffusion Steps
Hyunmo Kang, Noam Itzhak Levi, Corinna Elena Wegner +2
Sampling from learned high-dimensional distributions is a foundational computational problem. We introduce U-turn chains: Markov chains obtained by iterating short forward-backward…
Symmetry in language statistics shapes the geometry of model representations
Dhruva Karkada, Daniel J. Korchinski, Andres Nava +2
The internal representations learned by language models consistently exhibit striking geometric structure: calendar months organize into a circle, historical years form a smooth on…
On the Emergence of Linear Analogies in Word Embeddings
Daniel J. Korchinski, Dhruva Karkada, Yasaman Bahri +1
Models such as Word2Vec and GloVe construct word embeddings based on the co-occurrence probability of words and in text corpora. The resulting vectors not on…
Microscopic description of the intermittent dynamics driving logarithmic creep
Daniel J. Korchinski, Dor Shohat, Yoav Lahini +1
Disordered materials under an imposed forcing can display creep and aging effects, accompanied by intermittent, spatially heterogeneous dynamics. We propose a unifying microscopic…
Thermally activated intermittent flow in amorphous solids
Daniel J. Korchinski, Jörg Rottler
Using mean field theory and a mesoscale elastoplastic model, we analyze the steady state shear rheology of thermally activated amorphous solids. At sufficiently high temperature an…
Dynamic phase diagram of plastically deformed amorphous solids at finite temperature
Daniel Korchinski, Jörg Rottler
The yielding transition that occurs in amorphous solids under athermal quasistatic deformation has been the subject of many theoretical and computational studies. Here, we extend t…
Signatures of the spatial extent of plastic events in the yielding transition in amorphous solids
Daniel Korchinski, Céline Ruscher, Jörg Rottler
Amorphous solids are yield stress materials that flow when a sufficient load is applied. Their flow consists of periods of elastic loading interrupted by rapid stress drops, or ava…
Criticality in spreading processes without time-scale separation and the critical brain hypothesis
Daniel J. Korchinski, Javier G. Orlandi, Seung-Woo Son +1
Spreading processes on networks are ubiquitous in both human-made and natural systems. Understanding their behavior is of broad interest; from the control of epidemics to understan…
Measurement-device-independent quantum key distribution: from idea towards application
Raju Valivarthi, Itzel Lucio-Martinez, Philip Chan +13
We assess the overall performance of our quantum key distribution (QKD) system implementing the measurement-device-independent (MDI) protocol using components with varying capabili…