Constitutional adapters: Inference-time interventions for misalignment and misuse

Adam S. Lowet, Mark Kurzeja

Training models to act in accordance with an explicitly defined set of principles, or "constitution," has shown promise as a robust and transparent mechanism for AI alignment. Howe…