Neural Network Layer Matrix Decomposition reveals Latent Manifold Encoding and Memory Capacity

Ng Shyh-Chang, A-Li Luo, Bo Qiu

We prove the converse of the universal approximation theorem, i.e. a neural network (NN) encoding theorem which shows that for every stably converged NN of continuous activation fu…