Network Degeneracy as an Indicator of Training Performance: Comparing Finite and Infinite Width Angle Predictions

Cameron Jakub, Mihai Nica

Neural networks are powerful functions with widespread use, but the theoretical behaviour of these functions is not fully understood. Creating deep neural networks by stacking many…