Parisi Phase in a Neuron

Abstract

Pattern storage by a single neuron is revisited. Generalizing Parisi's framework for spin glasses we obtain a variational free energy functional for the neuron. The solution is demonstrated at high temperature and large relative number of examples, where several phases are identified by thermodynamical stability analysis, two of them exhibiting spontaneous full replica symmetry breaking. We give analytically the curved segments of the order parameter function and in representative cases compute the free energy, the storage error, and the entropy.

4 pages in prl twocolumn format + 3 Postscript figures. Submitted to Physical Review Letters

Cited by in corpus (8)

• Universal Spectrum of Normal Modes in Low-Temperature Glasses: an Exact Solution
• The simplest model of jamming
• Critical jammed phase of the linear perceptron
• Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron
• Parisi-Symmetry of the Many-Body Quantum Theory of randomly interacting fermionic systems
• Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking
• Statistical Mechanics of Soft Margin Classifiers
• Correlations between hidden units in multilayer neural networks and replica symmetry breaking