Dynamic Evolution of Complex Networks: A Reinforcement Learning Approach Applying Evolutionary Games to Community Structure

Abstract

Complex networks serve as abstract models for understanding real-world complex systems and provide frameworks for studying structured dynamical systems. This article addresses limitations in current studies on the exploration of individual birth-death and the development of community structures within dynamic systems. To bridge this gap, we propose a networked evolution model that includes the birth and death of individuals, incorporating reinforcement learning through games among individuals. Each individual has a lifespan following an arbitrary distribution, engages in games with network neighbors, selects actions using Q-learning in reinforcement learning, and moves within a two-dimensional space. The developed theories are validated through extensive experiments. Besides, we observe the evolution of cooperative behaviors and community structures in systems both with and without the birth-death process. The fitting of real-world populations and networks demonstrates the practicality of our model. Furthermore, comprehensive analyses of the model reveal that exploitation rates and payoff parameters determine the emergence of communities, learning rates affect the speed of community formation, discount factors influence stability, and two-dimensional space dimensions dictate community size. Our model offers a novel perspective on real-world community development and provides a valuable framework for studying population dynamics behaviors.

References in corpus (18)

• The structure and function of complex networks
• Power-law distributions in empirical data
• Power laws, Pareto distributions and Zipf's law
• Link Prediction in Complex Networks: A Survey
• Networks beyond pairwise interactions: structure and dynamics
• Statistical physics of human cooperation
• Evolutionary games on multilayer networks: A colloquium
• Small-world properties of the Indian Railway network
• Synchronization transitions on scale-free neuronal networks due to finite information transmission delays
• Maximal planar networks with large clustering coefficient and power-law degree distribution
• Co-evolutionary games on networks
• Evolutionary dynamics with game transitions
• The evolution of trust and trustworthiness
• An Evolutionary Game With the Game Transitions Based on the Markov Process
• Border Detection in Complex Networks
• Social Diversity Reduces the Complexity and Cost of Fostering Fairness
• LocalDrop: A Hybrid Regularization for Deep Neural Networks
• Social learning with complex contagion

Cited by in corpus (6)

• Effects of Stochastic Games on Evolutionary Dynamics in Structured Populations
• Evolutionary Cooperation with Game Transitions via Markov Decision Chain in Networked Population
• Shaping the learning signal in a combined Q-learning rule to improve structured cooperation
• Reputation assimilation mechanism for sustaining cooperation
• Evolutionary Dynamics of Variable Games in Structured Populations
• Supervised tax compliance and evasion from a spatial evolutionary game perspective