Neural networks are a priori biased towards Boolean functions with low entropy

Chris Mingard, Joar Skalse, Guillermo Valle-Pérez +3

Understanding the inductive bias of neural networks is critical to explaining their ability to generalise. Here, for one of the simplest neural networks -- a single-layer perceptro…