A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challenges

Abstract

Moral values have deep roots in early civilizations, codified within norms and laws that regulated societal order and the common good. They play a crucial role in understanding the psychological basis of human behavior and cultural orientation. The Moral Foundation Theory (MFT) is a well-established framework that identifies the core moral foundations underlying the manner in which different cultures shape individual and social lives. Recent advancements in natural language processing, particularly Pre-trained Language Models (PLMs), have enabled the extraction and analysis of moral dimensions from textual data. This survey presents a comprehensive review of MFT-informed PLMs, providing an analysis of moral tendencies in PLMs and their application in the context of the MFT. We also review relevant datasets and lexicons and discuss trends, limitations, and future directions. By providing a structured overview of the intersection between PLMs and MFT, this work bridges moral psychology insights within the realm of PLMs, paving the way for further research and development in creating morally aware AI systems.

Accepted for publication with AI & Society, March 2025

References in corpus (13)

• LLaMA: Open and Efficient Foundation Language Models
• Cultural Bias and Cultural Alignment of Large Language Models
• Evaluating Large Language Models: A Comprehensive Survey
• Aligning Large Language Models with Human: A Survey
• A Holistic Framework for Analyzing the COVID-19 Vaccine Debate
• Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM arguments
• MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussions
• LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty
• Contextualized moral inference
• Moral Narratives Around the Vaccination Debate on Facebook
• Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Data
• Moral Values Underpinning COVID-19 Online Communication Patterns
• Contextual Moral Value Alignment Through Context-Based Aggregation