Wide Neural Networks as Gaussian Processes: Lessons from Deep Equilibrium Models

Tianxiang Gao, Xiaokai Huo, Hailiang Liu +1

Neural networks with wide layers have attracted significant attention due to their equivalence to Gaussian processes, enabling perfect fitting of training data while maintaining ge…