Estimating the Probability of Sampling a Trained Neural Network at Random

Adam Scherlis, Nora Belrose

We present and analyze an algorithm for estimating the size, under a Gaussian or uniform measure, of a localized neighborhood in neural network parameter space with behavior simila…