1 paper · 1 filter
Jerry Yao-Chieh Hu, Yu-An Chen, Maojiang Su +1
We revisit the statistical mechanics of Transformer attention via modern Hopfield models. We present a free-energy formalism to characterize parameter regimes and critical threshol…