Retrieval Phase Diagrams of Non-monotonic Hopfield Networks

Abstract

We investigate the retrieval phase diagrams of an asynchronous fully-connected attractor network with non-monotonic transfer function by means of a mean-field approximation. We find for the noiseless zero-temperature case that this non-monotonic Hopfield network can store more patterns than a network with monotonic transfer function investigated by Amit et al. Properties of retrieval phase diagrams of non-monotonic networks agree with the results obtained by Nishimori and Opris who treated synchronous networks. We also investigate the optimal storage capacity of the non-monotonic Hopfield model with state-dependent synaptic couplings introduced by Zertuche et el. We show that the non-monotonic Hopfield model with state-dependent synapses stores more patterns than the conventional Hopfield model. Our formulation can be easily extended to a general transfer function.

arXiv commentLatex 13 pages using IOP style file

Cited by in corpus (7)

• On-Line AdaTron Learning of Unlearnable Rules
• On-line learning of non-monotonic rules by simple perceptron
• Pattern-recalling processes in quantum Hopfield networks far from saturation
• Statistical physics of neural systems with non-additive dendritic coupling
• Retrieval and Chaos in Extremely Diluted Non-Monotonic Neural Networks
• Generalization ability of a perceptron with non-monotonic transfer function
• A replica approach to the state-dependent synapses neural network