SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness

Mohammadamin Tavakoli, Forest Agostinelli, Pierre Baldi

We introduce SPLASH units, a class of learnable activation functions shown to simultaneously improve the accuracy of deep neural networks while also improving their robustness to a…