Deep Neural Networks with Trainable Activations and Controlled Lipschitz Constant

Shayan Aziznejad, Harshit Gupta, Joaquim Campos +1

We introduce a variational framework to learn the activation functions of deep neural networks. Our aim is to increase the capacity of the network while controlling an upper-bound…