171 citations · 686 across the 20 of their papers we have counts for
4 papers · 1 filter
End-to-end Differentiable Clustering with Associative Memories
Bishwajit Saha, Dmitry Krotov, Mohammed J. Zaki +1
Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are differentiable neural network…
Long Sequence Hopfield Memory
Hamza Tahir Chaudhry, Jacob A. Zavatone-Veth, Dmitry Krotov +1
Sequence memory is an essential attribute of natural and artificial intelligence that enables agents to encode, store, and retrieve complex sequences of stimuli and actions. Comput…
Sparse Distributed Memory is a Continual Learner
Trenton Bricken, Xander Davies, Deepak Singh +2
Continual learning is a problem for artificial neural networks that their biological counterparts are adept at solving. Building on work using Sparse Distributed Memory (SDM) to co…
Energy Transformer
Benjamin Hoover, Yuchen Liang, Bao Pham +5
Our work combines aspects of three promising paradigms in machine learning, namely, attention mechanism, energy-based models, and associative memory. Attention is the power-house d…