Reverse-Engineering Deep ReLU Networks

David Rolnick, Konrad P. Kording

It has been widely assumed that a neural network cannot be recovered from its outputs, as the network depends on its parameters in a highly nonlinear way. Here, we prove that in fa…