Asymptotic convexity of wide and shallow neural networks

Vivek Borkar, Parthe Pandit

For a simple model of shallow and wide neural networks, we show that the epigraph of its input-output map as a function of the network parameters approximates epigraph of a. convex…