Kernel shape renormalization explains output-output correlations in finite Bayesian one-hidden-layer networks

P. Baglioni, L. Giambagli, A. Vezzani +3

Finite-width one hidden layer networks with multiple neurons in the readout layer display non-trivial output-output correlations that vanish in the lazy-training infinite-width lim…