2 papers
cs.LG2026
Hybrid Associative Memories
Leon Lufkin, Tomás Figliolia, Beren Millidge +1
Recurrent neural networks (RNNs) and self-attention are both widely used sequence-mixing layers that maintain an internal memory. However, this memory is constructed using two orth…
cs.LG2025
A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks
Cutter Dawes, Simon Segert, Kamesh Krishnamurthy +1
A major challenge in the use of neural networks both for modeling human cognitive function and for artificial intelligence is the design of systems with the capacity to efficiently…