Unsupervised Elicitation of Moral Values from Language Models

Meysam Alizadeh, Fabrizio Gilardi, Zeynab Samei

As AI systems become pervasive, grounding their behavior in human values is critical. Prior work suggests that language models (LMs) exhibit limited inherent moral reasoning, leadi…