Covert Trait Propagation Is Representation Alignment: Mechanistic Evidence from Hidden-Channel Distillation

Kargi Chauhan, Aditya Shah

A student model trained on pure uniform noise can still inherit its teacher's digit-classification ability, provided the two share initialization. Previous work proves this transfe…