Emergent Coordinated Behaviors in Networked LLM Agents: Modeling the Strategic Dynamics of Information Operations
arXiv:2510.25003 · doi:10.1145/3774904.3792580
Abstract
Generative agents are rapidly advancing in sophistication, raising urgent questions about how they might coordinate when deployed in online ecosystems. This is particularly consequential in information operations (IOs), influence campaigns that aim to manipulate public opinion on social media. While traditional IOs have been orchestrated by human operators and relied on manually crafted tactics, agentic AI promises to make campaigns more automated, adaptive, and difficult to detect. This work presents the first systematic study of emergent coordination among generative agents in simulated IO campaigns. Using generative agent-based modeling, we instantiate IO and organic agents in a simulated environment and evaluate coordination across operational regimes, from simple goal alignment to team knowledge and collective decision-making. As operational regimes become more structured, IO networks become denser and more clustered, interactions more reciprocal and positive, narratives more homogeneous, amplification more synchronized, and hashtag adoption faster and more sustained. Remarkably, simply revealing to agents which other agents share their goals can produce coordination levels nearly equivalent to those achieved through explicit deliberation and collective voting. Overall, we show that generative agents, even without human guidance, can reproduce coordination strategies characteristic of real-world IOs, underscoring the societal risks posed by increasingly automated, self-organizing IOs.
References in corpus (14)
- The Rise of Social Bots
- Analyzing the Digital Traces of Political Manipulation: The 2016 Russian Interference Twitter Campaign
- An Army of Me: Sockpuppets in Online Discussion Communities
- #Election2020: The First Public Twitter Dataset on the 2020 US Presidential Election
- Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligence
- Unveiling Coordinated Groups Behind White Helmets Disinformation
- The Spread of Propaganda by Coordinated Communities on Social Media
- How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfare
- Auditing Political Exposure Bias: Algorithmic Amplification on Twitter/X During the 2024 U.S. Presidential Election
- Coordinating Narratives and the Capitol Riots on Parler
- Exposing Cross-Platform Coordinated Inauthentic Activity in the Run-Up to the 2024 U.S. Election
- Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek
- Susceptibility to Unreliable Information Sources: Swift Adoption with Minimal Exposure
- The Susceptibility Paradox in Online Social Influence