Verbalizing Subliminal Learning Effects Using Text Optimization

Nathan Hu, Sanmi Koyejo, Christopher Potts

Subliminal learning is a phenomenon in which a distillation dataset transmits traits from the teacher model that are not legibly encoded in the dataset itself. This introduces a ne…