A Reputation Game Simulation: Emergent Social Phenomena from Information Theory

Abstract

Reputation is a central element of social communications, be it with human or artificial intelligence (AI), and as such can be the primary target of malicious communication strategies. There is already a vast amount of literature on trust networks addressing this issue and proposing ways to simulate these networks dynamics using Bayesian principles and involving Theory of Mind models. The main issue for these simulations is usually the amount of information that can be stored and is usually solved by discretising variables and using hard thresholds. Here we propose a novel approach to the way information is updated that accounts for knowledge uncertainty and is closer to reality. In our game, agents use information compression techniques to capture their complex environment and store it in their finite memories. The loss of information that results from this leads to emergent phenomena, such as echo chambers, self-deception, deception symbiosis, and freezing of group opinions. Various malicious strategies of agents are studied for their impact on group sociology, like sycophancy, egocentricity, pathological lying, and aggressiveness. Even though our modeling could be made more complex, our set-up can already provide insights into social interactions and can be used to investigate the effects of various communication strategies and find ways to counteract malicious ones. Eventually this work should help to safeguard the design of non-abusive AI systems.

arXiv comment36 pages main part + 17 pages appendix, 28 figures, 3 tables, latex glitches fixed, revised and resubmitted

References in corpus (16)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Statistical physics of social dynamics
• The science of fake news
• Epidemic processes in complex networks
• Identification of influential spreaders in complex networks
• Statistical physics of human cooperation
• Information field theory for cosmological perturbation reconstruction and non-linear signal analysis
• Effects of Deception in Social Networks
• Inference with minimal Gibbs free energy in information field theory
• Information theory for fields
• Optimal Belief Approximation
• Information field dynamics for simulation scheme construction
• Simulation of stochastic network dynamics via entropic matching
• Consistency and convergence of simulation schemes in Information field dynamics
• Towards information optimal simulation of partial differential equations
• Agent mental models and Bayesian rules as a tool to create opinion dynamics models

Cited by in corpus (1)

• Quantifying imperfect cognition via achieved information gain