Showing 2025Show all
2 papers · 1 filter
cs.LG2025
On Weak-to-Strong Generalization and f-Divergence
Wei Yao, Gengze Xu, Huayi Tang +4
Weak-to-strong generalization (W2SG) has emerged as a promising paradigm for stimulating the capabilities of strong pre-trained models by leveraging supervision from weaker supervi…
cs.LG2025
Weak-to-Strong Generalization via Bregman Bias-Variance Decomposition
Gengze Xu, Wei Yao, Ziqiao Wang +1
Weak-to-strong generalization (W2SG) is the phenomenon in which a powerful student model, trained on labels produced by a weaker teacher, ultimately outperforms the teacher on the…