4 papers
Natural-Logarithm-Rectified Activation Function in Convolutional Neural Networks
Yang Liu, Jianpeng Zhang, Chao Gao +2
Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation fun…
A Sensitivity Analysis of Attention-Gated Convolutional Neural Networks for Sentence Classification
Yang Liu, Jianpeng Zhang, Chao Gao +2
In this paper, we investigate the effect of different hyperparameters as well as different combinations of hyperparameters settings on the performance of the Attention-Gated Convol…
An Attention-Gated Convolutional Neural Network for Sentence Classification
Yang Liu, Lixin Ji, Ruiyang Huang +3
The classification of sentences is very challenging, since sentences contain the limited contextual information. In this paper, we proposed an Attention-Gated Convolutional Neural…
N-fold Superposition: Improving Neural Networks by Reducing the Noise in Feature Maps
Yang Liu, Qiang Qu, Chao Gao
Considering the use of Fully Connected (FC) layer limits the performance of Convolutional Neural Networks (CNNs), this paper develops a method to improve the coupling between the c…