Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention

Gilhan Kim, Daniel K. Park

Attention mechanisms are central to modern sequence models, yet standard attention computes relevance primarily through individual query--key similarities. Although softmax normali…