Network Hierarchy and Pattern Recovery in Directed Sparse Hopfield Networks
arXiv:2202.00350 · doi:10.1103/PhysRevE.105.064304
Abstract
Many real-world networks are directed, sparse and hierarchical, with a mixture of feed-forward and feedback connections with respect to the hierarchy. Moreover, a small number of 'master' nodes are often able to drive the whole system. We study the dynamics of pattern presentation and recovery on sparse, directed, Hopfield-like neural networks using Trophic Analysis to characterise their hierarchical structure. This is a recent method which quantifies the local position of each node in a hierarchy (trophic level) as well as the global directionality of the network (trophic coherence). We show that even in a recurrent network, the state of the system can be controlled by a small subset of neurons which can be identified by their low trophic levels. We also find that performance at the pattern recovery task can be significantly improved by tuning the trophic coherence and other topological properties of the network. This may explain the relatively sparse and coherent structures observed in the animal brain, and provide insights for improving the architectures of artificial neural networks. Moreover, we expect that the principles we demonstrate, through numerical analysis, here will be relevant for a broad class of system whose underlying network structure is directed and sparse, such as biological, social or financial networks.
arXiv comment14 pages, 15 figures
References in corpus (15)
- Control Principles of Complex Networks
- Non-reciprocal phase transitions
- The physics of brain network structure, function, and control
- Trophic coherence determines food-web stability
- Resilience or Robustness: Identifying Topological Vulnerabilities in Rail Networks
- Looplessness in networks is linked to trophic coherence
- Topological resilience in non-normal networked systems
- Estimating the impact of structural directionality: How reliable are undirected connectomes?
- Transition from regular to complex behaviour in a discrete deterministic asymmetric neural network model
- The Little-Hopfield model on a Random Graph
- Control of asymmetric Hopfield networks and application to cancer attractors
- From neurons to epidemics: How trophic coherence affects spreading processes
- Synchronization dynamics in non-normal networks: the trade-off for optimality
- Cell cycle time series gene expression data encoded as cyclic attractors in Hopfield systems
- Hope4Genes: a Hopfield-like class prediction algorithm for transcriptomic data