Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

Abstract

On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3, the largest publicly-disclosed dense language model at the time. The meeting took place under Chatham House Rules. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy, and more. Broadly, the discussion centered around two main questions: 1) What are the technical capabilities and limitations of large language models? 2) What are the societal effects of widespread use of large language models? Here, we provide a detailed summary of the discussion organized by the two themes above.

Cited by in corpus (18)

• Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
• Understanding Large-Language Model (LLM)-powered Human-Robot Interaction
• The Social Impact of Generative AI: An Analysis on ChatGPT
• LEVA: Using Large Language Models to Enhance Visual Analytics
• Alignment of Language Agents
• A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models
• Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review
• Dual Use Concerns of Generative AI and Large Language Models
• Two Directions for Clinical Data Generation with Large Language Models: Data-to-Label and Label-to-Data
• A Survey of the Potential Long-term Impacts of AI
• AI Challenges for Society and Ethics
• Will Code Remain a Relevant User Interface for End-User Programming with Generative AI Models?
• Framing the News:From Human Perception to Large Language Model Inferences
• Societal Biases in Language Generation: Progress and Challenges
• What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
• Logic-Scaffolding: Personalized Aspect-Instructed Recommendation Explanation Generation using LLMs
• Enhancing Cross-Modal Contextual Congruence for Crowdfunding Success using Knowledge-infused Learning
• Cut the CARP: Fishing for zero-shot story evaluation