The Capacity of Modern Hopfield Networks under the Data Manifold Hypothesis
arXiv:2503.09518
Abstract
We generalize the computation of the capacity of exponential Hopfield model from Lucibello and Mézard (2024) to more generic pattern ensembles, including binary patterns and patterns generated from a hidden manifold model.
ICLR 2025 Workshop Paper, 9 pages, 2 figures