Penalising the biases in norm regularisation enforces sparsity

Etienne Boursier, Nicolas Flammarion

Controlling the parameters' norm often yields good generalisation when training neural networks. Beyond simple intuitions, the relation between regularising parameters' norm and ob…