Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks

Andrea Ceni

Since the recognition in the early nineties of the vanishing/exploding (V/E) gradient issue plaguing the training of neural networks (NNs), significant efforts have been exerted to…