SoFA: Shielded On-the-fly Alignment via Priority Rule Following

Xinyu Lu, Bowen Yu, Yaojie Lu +5

The alignment problem in Large Language Models (LLMs) involves adapting them to the broad spectrum of human values. This requirement challenges existing alignment methods due to di…