Out-of-Distribution Generalization of Risk Aversion in Language Models

Kristina Zhang, Junior Chinomso Okoroafor, Benjamin Maltbie +3

Training AIs to be risk-averse in resources could offer a failsafe in the event that AIs turn out misaligned. Misaligned but risk-averse AIs would tend to prefer low-risk, low-rewa…