Neural Networks with Complex-Valued Weights Have No Spurious Local Minima

Xingtu Liu

We study the benefits of complex-valued weights for neural networks. We prove that shallow complex neural networks with quadratic activations have no spurious local minima. In cont…