Large Language Model Unlearning

Yuanshun Yao, Xiaojun Xu, Yang Liu

We study how to perform unlearning, i.e. forgetting undesirable misbehaviors, on large language models (LLMs). We show at least three scenarios of aligning LLMs with human preferen…