Watch the Model Think: On-Policy Extraction of Activation Steering Vectors

Xuanbo Su, Hao Luo, Yingfang Zhang +4

When a model solves a problem on one attempt and fails it on the next, what separates the two is rarely the final answer token; it is the trajectory that reached it. Contrastive ac…