2 papers
cs.LG2026
Attention as In-Context Empirical Bayes: A Two-Stage View via Particle Dynamics
Matthew Smart, Soumya Ganguly, Nilava Metya +2
We study minimal attention-only transformers under all-token corruption and show they admit a two-stage empirical Bayes interpretation. A single attention step computes a kernel-we…
cond-mat.stat-mech2026
Coarse-grained Shannon entropy of random walks with shrinking steps
Alexander Feigel, Alexandre V. Morozov
In one-dimensional diffusive processes with discrete steps characterized by geometrically decaying magnitudes, the usual Gaussian broadening familiar from Brownian motion is replac…