How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance

Hongkang Li, Shuai Zhang, Yihua Zhang +3

Group imbalance has been a known problem in empirical risk minimization (ERM), where the achieved high average accuracy is accompanied by low accuracy in a minority group. Despite…