Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer

Qinyang Xu

Subliminal trait transfer allows a student model to acquire behavioral dispositions from teacher-generated data in which the trait is not semantically expressed. Recent work explai…