Dropout in Training Neural Networks: Flatness of Solution and Noise Structure

Zhongwang Zhang, Hanxu Zhou, Zhi-Qin John Xu

It is important to understand how the popular regularization method dropout helps the neural network training find a good generalization solution. In this work, we show that the tr…