The Safety Operator: Modulating the Expression of Safety Instructions via Spectral Optimization

Benoit Dherin, Michael Munn, Xavier Gonzalvo +14

Context tokens in a transformer-based language model can be absorbed into the model's weights as a multiplicative operator. We study this operator in the setting of safety instruct…