How Much Do Activation Monitors Benefit from Original Model Computations?

James Oldfield, Shawn Im, Jay J Culligan +3

One powerful way to safeguard AI systems is to monitor their internal computations--where signs of undesirable behavior might be more easily detectable than from models' inputs and…