Replica Symmetry Breaking in Attractor Neural Network Models

Abstract

The phenomenon of replica symmetry breaking is investigated for the retrieval phases of Hopfield-type network models. The basic calculation is done for the generalized version of the standard model introduced by Horner [1] and by Perez-Vicente and Amit [2] which can exhibit low mean levels of neural activity. For a mean activity $\bar{a}=1/2$ the Hopfield model is recovered. In this case, surprisingly enough, we cannot confirm the well known one step replica symmetry breaking (1RSB) result for the storage capacity which was presented by Crisanti, Amit and Gutfreund [3] ($α_c^{\hbox{\mf 1RSB}}\simeq 0.144$). Rather, we find that 1RSB- and 2RSB-Ansätze yield only slightly increased capacities as compared to the replica symmetric value ($α_c^{\hbox{\mf 1RSB}}\simeq 0.138\,186$ and $α_c^{\hbox{\mf 2RSB}}\simeq 0.138\,187 $ compared to $α_c^{\hbox{\mf RS}}\simeq 0.137\,905$), significantly smaller also than the value $α_c^{\hbox{\mf sim}} = 0.145\pm 0.009$ reported from simulation studies. These values still lie within the recently discovered reentrant phase [4]. We conjecture that in the infinite Parisi-scheme the reentrant behaviour disappears as is the case in the SK-spin-glass model (Parisi--Toulouse-hypothesis). The same qualitative results are obtained in the low activity range.

Latex file, 20 pages, 8 Figures available from the authors upon request, HD-TVP-94-4

Cited by in corpus (9)

• Glassy Vortex State in a Two-Dimensional Disordered XY-Model
• Quantum Effects in Neural Networks
• Cross-talk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: phase diagram (I)
• Replica symmetry breaking in dense neural networks
• Non-linear PDEs approach to statistical mechanics of Dense Associative Memories
• The Ashkin-Teller neural network near saturation
• A generalized Hopfield model to store and retrieve mismatched memory patterns
• On the role of non-linear latent features in bipartite generative neural networks
• A replica approach to the state-dependent synapses neural network