Efficient Deep Learning of GMMs

Shirin Jalali, Carl Nuzman, Iraj Saniee

We show that a collection of Gaussian mixture models (GMMs) in $R^n$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural netw…