Provable Weak-to-Strong Generalization via Benign Overfitting

David X. Wu, Anant Sahai

The classic teacher-student model in machine learning posits that a strong teacher supervises a weak student to improve the student's capabilities. We instead consider the inverted…