Contrastive Weak-to-strong Generalization

Houcheng Jiang, Junfeng Fang, Jiaxin Wu +5

Weak-to-strong generalization provides a promising paradigm for scaling large language models (LLMs) by training stronger models on samples from aligned weaker ones, without requir…