Rosenblatt's first theorem and frugality of deep learning

A. N. Kirdin, S. V. Sidorov, N. Y. Zolotykh

First Rosenblatt's theorem about omnipotence of shallow networks states that elementary perceptrons can solve any classification problem if there are no discrepancies in the traini…