Reconstructing the Hopfield network as an inverse Ising problem

Abstract

We test four fast mean field type algorithms on Hopfield networks as an inverse Ising problem. The equilibrium behavior of Hopfield networks is simulated through Glauber dynamics. In the low temperature regime, the simulated annealing technique is adopted. Although performances of these network reconstruction algorithms on the simulated network of spiking neurons are extensively studied recently, the analysis of Hopfield networks is lacking so far. For the Hopfield network, we found that, in the retrieval phase favored when the network wants to memory one of stored patterns, all the reconstruction algorithms fail to extract interactions within a desired accuracy, and the same failure occurs in the spin glass phase where spurious minima show up, while in the paramagnetic phase, albeit unfavored during the retrieval dynamics, the algorithms work well to reconstruct the network itself. This implies that, as a inverse problem, the paramagnetic phase is conversely useful for reconstructing the network while the retrieval phase loses all the information about interactions in the network except for the case where only one pattern is stored. The performances of algorithms are studied with respect to the system size, memory load and temperature, sample-to-sample fluctuations are also considered.

8 pages, 3 figures

References in corpus (5)

• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Prediction of spatio-temporal patterns of neural activity from pairwise correlations
• Statistical physics of pairwise probability models
• Small-correlation expansions for the inverse Ising problem
• Inference algorithms for gene networks: a statistical mechanics analysis

Cited by in corpus (7)

• Inference and learning in sparse systems with multiple states
• Free energies of Boltzmann Machines: self-averaging, annealed and replica symmetric approximations in the thermodynamic limit
• Message passing algorithms for the Hopfield network reconstruction: threshold behavior and limitation
• Sparse Hopfield network reconstruction with ${\ell }_1$ regularization
• Quantum Hopfield Model with Dilute Memories
• Inverse problems in spin models
• State sampling dependence of the Hopfield network inference