Estimating Multiplicative Relations in Neural Networks

Bhaavan Goel

Universal approximation theorem suggests that a shallow neural network can approximate any function. The input to neurons at each layer is a weighted sum of previous layer neurons…