Advantages of biologically-inspired adaptive neural activation in RNNs during learning

Victor Geadah, Giancarlo Kerg, Stefan Horoi +2

Dynamic adaptation in single-neuron response plays a fundamental role in neural coding in biological neural networks. Yet, most neural activation functions used in artificial netwo…