Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data

Xuran Meng, Difan Zou, Yuan Cao

Modern deep learning models are usually highly over-parameterized so that they can overfit the training data. Surprisingly, such overfitting neural networks can usually still achie…