2 citations · 3 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Self-attention as an attractor network: transient memories without backpropagation
Francesco D'Amico, Matteo Negri
Transformers are one of the most successful architectures of modern neural networks. At their core there is the so-called attention mechanism, which recently interested the physics…
cond-mat.dis-nn2024★ 2 cited
Random Features Hopfield Networks generalize retrieval to previously unseen examples
Silvio Kalaj, Clarissa Lauditi, Gabriele Perugini +3
It has been recently shown that a learning transition happens when a Hopfield Network stores examples generated as superpositions of random features, where new attractors correspon…