Concept Extrapolation: A Conceptual Primer
arXiv:2306.10999
Abstract
This article is a primer on concept extrapolation - the ability to take a concept, a feature, or a goal that is defined in one context and extrapolate it safely to a more general context. Concept extrapolation aims to solve model splintering - a ubiquitous occurrence wherein the features or concepts shift as the world changes over time. Through discussing value splintering and value extrapolation the article argues that concept extrapolation is necessary for Artificial Intelligence alignment.
Accepted at the AAMAS-23 First International Workshop on Citizen-Centric Multiagent Systems held at the 22nd International Conference on Autonomous Agents and Multiagent Systems, 6 pages