3 papers
cs.LG2019
Natural-Logarithm-Rectified Activation Function in Convolutional Neural Networks
Yang Liu, Jianpeng Zhang, Chao Gao +2
Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation fun…
cs.CL2019
A Sensitivity Analysis of Attention-Gated Convolutional Neural Networks for Sentence Classification
Yang Liu, Jianpeng Zhang, Chao Gao +2
In this paper, we investigate the effect of different hyperparameters as well as different combinations of hyperparameters settings on the performance of the Attention-Gated Convol…
cs.CL2018
An Attention-Gated Convolutional Neural Network for Sentence Classification
Yang Liu, Lixin Ji, Ruiyang Huang +3
The classification of sentences is very challenging, since sentences contain the limited contextual information. In this paper, we proposed an Attention-Gated Convolutional Neural…