189 citations · 1.7k across the 110 of their papers we have counts for
4 papers · 2 filters
Complex Structure Leads to Overfitting: A Structure Regularization Decoding Method for Natural Language Processing
Xu Sun, Weiwei Sun, Shuming Ma +4
Recent systems on structured prediction focus on increasing the level of structural dependencies within the model. However, our study suggests that complex structures entail high o…
Training Simplification and Model Simplification for Deep Learning: A Minimal Effort Back Propagation Method
Xu Sun, Xuancheng Ren, Shuming Ma +5
We propose a simple yet effective technique to simplify the training and the resulting model of neural networks. In back propagation, only a small subset of the full gradient is co…
Label Embedding Network: Learning Label Representation for Soft Training of Deep Networks
Xu Sun, Bingzhen Wei, Xuancheng Ren +1
We propose a method, called Label Embedding Network, which can learn label representation (label embedding) during the training process of deep networks. With the proposed method,…
meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting
Xu Sun, Xuancheng Ren, Shuming Ma +1
We propose a simple yet effective technique for neural network learning. The forward propagation is computed as usual. In back propagation, only a small subset of the full gradient…