Mapping the individual, social, and biospheric impacts of Foundation Models

Abstract

Responding to the rapid roll-out and large-scale commercialization of foundation models, large language models, and generative AI, an emerging body of work is shedding light on the myriad impacts these technologies are having across society. Such research is expansive, ranging from the production of discriminatory, fake and toxic outputs, and privacy and copyright violations, to the unjust extraction of labor and natural resources. The same has not been the case in some of the most prominent AI governance initiatives in the global north like the UK's AI Safety Summit and the G7's Hiroshima process, which have influenced much of the international dialogue around AI governance. Despite the wealth of cautionary tales and evidence of algorithmic harm, there has been an ongoing over-emphasis within the AI governance discourse on technical matters of safety and global catastrophic or existential risks. This narrowed focus has tended to draw attention away from very pressing social and ethical challenges posed by the current brute-force industrialization of AI applications. To address such a visibility gap between real-world consequences and speculative risks, this paper offers a critical framework to account for the social, political, and environmental dimensions of foundation models and generative AI. We identify 14 categories of risks and harms and map them according to their individual, social, and biospheric impacts. We argue that this novel typology offers an integrative perspective to address the most urgent negative impacts of foundation models and their downstream applications. We conclude with recommendations on how this typology could be used to inform technical and normative interventions to advance responsible AI.

ACM Conference on Fairness, Accountability, and Transparency (FAccT '24). Association for Computing Machinery, New York, NY, USA, 776-796

References in corpus (27)

• On the Opportunities and Risks of Foundation Models
• ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishing
• Successful Combination of Database Search and Snowballing for Identification of Primary Studies in Systematic Literature Studies
• Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
• Human heuristics for AI-generated language are flawed
• The Fallacy of AI Functionality
• Co-Writing with Opinionated Language Models Affects Users' Views
• Quantifying Memorization Across Neural Language Models
• Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators
• A Categorical Archive of ChatGPT Failures
• General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance
• Speciesist bias in AI -- How AI applications perpetuate discrimination and unfair outcomes against animals
• Differentiate ChatGPT-generated and Human-written Medical Texts
• DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models
• Model evaluation for extreme risks
• Robots Enact Malignant Stereotypes
• "I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation
• Capturing Failures of Large Language Models via Human Cognitive Biases
• Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support
• Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks
• MEGA: Multilingual Evaluation of Generative AI
• On the Risk of Misinformation Pollution with Large Language Models
• Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identity
• Assessing Language Model Deployment with Risk Cards
• Towards Understanding the Interplay of Generative Artificial Intelligence and the Internet
• Co-creating a Transdisciplinary Map of Technology-mediated Harms, Risks and Vulnerabilities: Challenges, Ambivalences and Opportunities
• MISGENDERED: Limits of Large Language Models in Understanding Pronouns