Stationary Activations for Uncertainty Calibration in Deep Learning

Lassi Meronen, Christabella Irwanto, Arno Solin

We introduce a new family of non-linear neural network activation functions that mimic the properties induced by the widely-used Matérn family of kernels in Gaussian process (GP) m…