Swim: A General-Purpose, High-Performing, and Efficient Activation Function for Locomotion Control Tasks

Maryam Abdool, Tony Dear

Activation functions play a significant role in the performance of deep learning algorithms. In particular, the Swish activation function tends to outperform ReLU on deeper models,…