Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks

Ali Hussaini Umar, Alessandro Laio

Neural networks are known to develop latent representations that are $aligned$, namely structurally similar across networks trained with different architectures, training protocols…