PatchBench: Measuring Collateral Damage in Activation Patching

Alexi Canesse, Mathis Le Bail, Maël Jenny +3

An LLM safety patch can pass a benchmark while still being a poor repair. This risk is especially acute for jailbreak repairs, where the goal is to correct a specific unsafe behavi…