A continuum among logarithmic, linear, and exponential functions, and its potential to improve generalization in neural networks

Luke B. Godfrey, Michael S. Gashler

We present the soft exponential activation function for artificial neural networks that continuously interpolates between logarithmic, linear, and exponential functions. This activ…