171 citations · 686 across the 20 of their papers we have counts for
20 papers
End-to-end Differentiable Clustering with Associative Memories
Bishwajit Saha, Dmitry Krotov, Mohammed J. Zaki +1
Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are differentiable neural network…
Long Sequence Hopfield Memory
Hamza Tahir Chaudhry, Jacob A. Zavatone-Veth, Dmitry Krotov +1
Sequence memory is an essential attribute of natural and artificial intelligence that enables agents to encode, store, and retrieve complex sequences of stimuli and actions. Comput…
Sparse Distributed Memory is a Continual Learner
Trenton Bricken, Xander Davies, Deepak Singh +2
Continual learning is a problem for artificial neural networks that their biological counterparts are adept at solving. Building on work using Sparse Distributed Memory (SDM) to co…
Energy Transformer
Benjamin Hoover, Yuchen Liang, Bao Pham +5
Our work combines aspects of three promising paradigms in machine learning, namely, attention mechanism, energy-based models, and associative memory. Attention is the power-house d…
Associative Learning for Network Embedding
Yuchen Liang, Dmitry Krotov, Mohammed J. Zaki
The network embedding task is to represent the node in the network as a low-dimensional vector while incorporating the topological and structural information. Most existing approac…
Hierarchical Associative Memory
Dmitry Krotov
Dense Associative Memories or Modern Hopfield Networks have many appealing properties of associative memory. They can do pattern completion, store a large number of memories, and c…