Effects of Feature Correlations on Associative Memory Capacity

Stefan Bielmeier, Gerald Friedland

We investigate how feature correlations influence the capacity of Dense Associative Memory (DAM), a Transformer attention-like model. Practical machine learning scenarios involve f…