Explosive neural networks via higher-order interactions in curved statistical manifolds
arXiv:2408.02326 · doi:10.1038/s41467-025-61475-w
Abstract
Higher-order interactions underlie complex phenomena in systems such as biological and artificial neural networks, but their study is challenging due to the scarcity of tractable models. By leveraging a generalisation of the maximum entropy principle, we introduce curved neural networks as a class of models with a limited number of parameters that are particularly well-suited for studying higher-order phenomena. Through exact mean-field descriptions, we show that these curved neural networks implement a self-regulating annealing process that can accelerate memory retrieval, leading to explosive order-disorder phase transitions with multi-stability and hysteresis effects. Moreover, by analytically exploring their memory-retrieval capacity using the replica trick, we demonstrate that these networks can enhance memory capacity and robustness of retrieval over classical associative-memory networks. Overall, the proposed framework provides parsimonious models amenable to analytical study, revealing higher-order phenomena in complex networks.
References in corpus (18)
- The physics of higher-order interactions in complex systems
- Simplicial models of social contagion
- Explosive higher-order Kuramoto dynamics on simplicial complexes
- Higher-order interactions in complex networks of phase oscillators promote abrupt synchronization switching
- Searching for collective behavior in a network of real neurons
- Explosive Phenomena in Complex Networks
- The effect of heterogeneity on hypergraph contagion models
- On a model of associative memory with huge storage capacity
- The simplest maximum entropy model for collective behavior in a neural network
- A Universal Route to Explosive Phenomena
- The low-rank hypothesis of complex systems
- Curie-Weiss magnet: a simple model of phase transition
- The Exponential Capacity of Dense Associative Memories
- Characterization of Time Series Via Rényi Complexity-Entropy Curves
- Non-linear PDEs approach to statistical mechanics of Dense Associative Memories
- Explosive Ising
- Properties of a Generalized Divergence Related to Tsallis Relative Entropy
- The Relativistic Hopfield network: rigorous results