Neural networks with transient state dynamics

Abstract

We investigate dynamical systems characterized by a time series of distinct semi-stable activity patterns, as they are observed in cortical neural activity patterns. We propose and discuss a general mechanism allowing for an adiabatic continuation between attractor networks and a specific adjoined transient-state network, which is strictly dissipative. Dynamical systems with transient states retain functionality when their working point is autoregulated; avoiding prolonged periods of stasis or drifting into a regime of rapid fluctuations. We show, within a continuous-time neural network model, that a single local updating rule for online learning allows simultaneously (i) for information storage via unsupervised Hebbian-type learning, (ii) for adaptive regulation of the working point and (iii) for the suppression of runaway synaptic growth. Simulation results are presented; the spontaneous breaking of time-reversal symmetry and link symmetry are discussed.

References in corpus (2)

• Periodic Neural Activity Induced by Network Complexity
• Autonomous Dynamics in Neural networks: The dHAN Concept and Associative Thought Processes

Cited by in corpus (17)

• Power laws and Self-Organized Criticality in Theory and Nature
• Complex and Adaptive Dynamical Systems: A Primer
• Self-organized chaos through polyhomeostatic optimization
• Intrinsic adaptation in autonomous recurrent neural networks
• A devil's advocate view on 'self-organized' brain criticality
• Evolving dynamical networks with transient cluster activity
• Closed-loop robots driven by short-term synaptic plasticity: Emergent explorative vs. limit-cycle locomotion
• Vertex routing models
• Attractor metadynamics in terms of target points in slow-fast systems: adiabatic vs. symmetry protected flow in a recurrent neural network
• Learning in cognitive systems with autonomous dynamics
• Semantic learning in autonomously active recurrent neural networks
• When the goal is to generate a series of activities: A self-organized simulated robot arm
• Multiple-timescale Neural Networks: Generation of Context-dependent Sequences and Inference through Autonomous Bifurcations
• Complex activity patterns generated by short-term synaptic plasticity
• Cognition and Emotion: Perspectives of a Closing Gap
• Generating functionals for autonomous latching dynamics in attractor relict networks
• Cognitive computation with autonomously active neural networks: an emerging field