STR: Supervised Transcoder Replacement for Reducing Steering Side Effects

Haonan Yu, Junhao Liu, Zhenyu Yan +2

Model steering can strengthen a target behavior while degrading other useful behaviors. We introduce Supervised Transcoder Replacement (STR) to reduce these side effects for existi…