Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels

Kangyu Weng, Aohua Cheng, Ziyang Zhang +2

In deep learning, neural networks serve as noisy channels between input data and its representation. This perspective naturally relates deep learning with the pursuit of constructi…