MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming

Abstract

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are crucial if LLMs are to effectively mimic human-like social behaviors and form efficient teams to solve tasks. To bridge this gap, we introduce MetaAgents, a social simulation framework populated with LLM-based agents. MetaAgents facilitates agent engagement in conversations and a series of decision making within social contexts, serving as an appropriate platform for investigating interactions and interpersonal decision-making of agents. In particular, we construct a job fair environment as a case study to scrutinize the team assembly and skill-matching behaviors of LLM-based agents. We take advantage of both quantitative metrics evaluation and qualitative text analysis to assess their teaming abilities at the job fair. Our evaluation demonstrates that LLM-based agents perform competently in making rational decisions to develop efficient teams. However, we also identify limitations that hinder their effectiveness in more complex team assembly tasks. Our work provides valuable insights into the role and evolution of LLMs in task-oriented social simulations.

References in corpus (6)

• Training language models to follow instructions with human feedback
• A Survey on Large Language Model based Autonomous Agents
• Out of One, Many: Using Language Models to Simulate Human Samples
• Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat
• Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation
• "My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents