Activation Functions for Generalized Learning Vector Quantization - A Performance Comparison

Thomas Villmann, John Ravichandran, Andrea Villmann +2

An appropriate choice of the activation function (like ReLU, sigmoid or swish) plays an important role in the performance of (deep) multilayer perceptrons (MLP) for classification…