A simple and efficient architecture for trainable activation functions

Andrea Apicella, Francesco Isgrò, Roberto Prevete

Learning automatically the best activation function for the task is an active topic in neural network research. At the moment, despite promising results, it is still difficult to d…