Decomposing Refusal Steering in Mixture-of-Experts Models

Anna C. Marbut, Daniel R. Olson, Travis J. Wheeler

Safety alignment in instruction-tuned large language models (LLMs) depends on a model's ability to reliably refuse harmful or disallowed requests. Recent work has shown that a stee…