A New Artificial Neuron Proposal with Trainable Simultaneous Local and Global Activation Function

Tiago A. E. Ferreira, Marios Mattheakis, Pavlos Protopapas

The activation function plays a fundamental role in the artificial neural network learning process. However, there is no obvious choice or procedure to determine the best activatio…