Deep Learning with S-shaped Rectified Linear Activation Units

Xiaojie Jin, Chunyan Xu, Jiashi Feng +3

Rectified linear activation units are important components for state-of-the-art deep convolutional networks. In this paper, we propose a novel S-shaped rectified linear activation…