Weak-to-Strong Generalization is Nearly Inevitable (in Linear Models)

Scott Geng, Dutch Hansen, Jerry Li

Weak-to-strong generalization is a phenomenon in post-training whereby a strong student model, when finetuned solely with feedback from a weaker teacher, can not only surpass the t…