Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum

Amnon Geifman, Daniel Barzilai, Ronen Basri +1

Wide neural networks are biased towards learning certain functions, influencing both the rate of convergence of gradient descent (GD) and the functions that are reachable with GD i…