2 papers
cs.LG2019
Natural-Logarithm-Rectified Activation Function in Convolutional Neural Networks
Yang Liu, Jianpeng Zhang, Chao Gao +2
Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation fun…
cs.CL2019
A Sensitivity Analysis of Attention-Gated Convolutional Neural Networks for Sentence Classification
Yang Liu, Jianpeng Zhang, Chao Gao +2
In this paper, we investigate the effect of different hyperparameters as well as different combinations of hyperparameters settings on the performance of the Attention-Gated Convol…