The path-integral analysis of an associative memory model storing an infinite number of finite limit cycles

Abstract

It is shown that an exact solution of the transient dynamics of an associative memory model storing an infinite number of limit cycles with l finite steps by means of the path-integral analysis. Assuming the Maxwell construction ansatz, we have succeeded in deriving the stationary state equations of the order parameters from the macroscopic recursive equations with respect to the finite-step sequence processing model which has retarded self-interactions. We have also derived the stationary state equations by means of the signal-to-noise analysis (SCSNA). The signal-to-noise analysis must assume that crosstalk noise of an input to spins obeys a Gaussian distribution. On the other hand, the path-integral method does not require such a Gaussian approximation of crosstalk noise. We have found that both the signal-to-noise analysis and the path-integral analysis give the completely same result with respect to the stationary state in the case where the dynamics is deterministic, when we assume the Maxwell construction ansatz. We have shown the dependence of storage capacity (alpha_c) on the number of patterns per one limit cycle (l). Storage capacity monotonously increases with the number of steps, and converges to alpha_c=0.269 at l ~= 10. The original properties of the finite-step sequence processing model appear as long as the number of steps of the limit cycle has order l=O(1).

arXiv comment24 pages, 3 figures

References in corpus (5)

• Phase Diagram and Storage Capacity of Sequence Processing Neural Networks
• Statistical Mechanics of Recurrent Neural Networks II. Dynamics
• Transient dynamics for sequence processing neural networks
• Synapse efficiency diverges due to synaptic pruning following over-growth
• The signal-to-noise analysis of the Little-Hopfield model revisited

Cited by in corpus (7)

• Rank abundance relations in evolutionary dynamics of random replicators
• Generating functional analysis of CDMA detection dynamics
• Period-two cycles in a feed-forward layered neural network model with symmetric sequence processing
• Pattern reconstruction and sequence processing in feed-forward layered neural networks near saturation
• Dynamical mean field approach to associative memory model with non-monotonic transfer functions
• Symmetric sequence processing in a recurrent neural network model with a synchronous dynamics
• Generating Functional Analysis for Iterative CDMA Multiuser Detectors