On Bridging the Gap between Mean Field and Finite Width in Deep Random Neural Networks with Batch Normalization

Amir Joudaki, Hadi Daneshmand, Francis Bach

Mean field theory is widely used in the theoretical studies of neural networks. In this paper, we analyze the role of depth in the concentration of mean-field predictions, specific…