Detecting Safety Training Modification in Language Models via Activation Analysis

Glen Messenger

We introduce AMS (Activation-based Model Scanner), a tool that detects modifications to safety training in language models by measuring the geometric structure of safety-relevant c…