most citedUnderstanding and Improving Layer Normalization

178 citations · 296 across the 4 of their papers we have counts for

collaborators

6 papers

cs.CL202010 cited

Graph-based Multi-hop Reasoning for Long Text Generation

Liang Zhao, Jingjing Xu, Junyang Lin +3

Long text generation is an important but challenging task.The main problem lies in learning sentence-level semantic dependencies which traditional generative models often suffer fr…

cs.CL201977 cited

Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection

Guangxiang Zhao, Junyang Lin, Zhiyuan Zhang +3

Self-attention based Transformer has demonstrated the state-of-the-art performances in a number of natural language processing tasks. Self-attention is able to model long-term depe…

cs.LG2019178 cited

Understanding and Improving Layer Normalization

Jingjing Xu, Xu Sun, Zhiyuan Zhang +2

Layer normalization (LayerNorm) is a technique to normalize the distributions of intermediate layers. It enables smoother gradients, faster training, and better generalization accu…

cs.CL2019

Towards Knowledge-Based Recommender Dialog System

Qibin Chen, Junyang Lin, Yichang Zhang +4

In this paper, we propose a novel end-to-end framework called KBRD, which stands for Knowledge-Based Recommender Dialog System. It integrates the recommender system and the dialog…

cs.CL201931 cited

Imitation Learning for Non-Autoregressive Neural Machine Translation

Bingzhen Wei, Mingxuan Wang, Hao Zhou +3

Non-autoregressive translation models (NAT) have achieved impressive inference speedup. A potential issue of the existing NAT algorithms, however, is that the decoding is conducted…

cs.CL2019

Towards Knowledge-Based Personalized Product Description Generation in E-commerce

Qibin Chen, Junyang Lin, Yichang Zhang +3

Quality product descriptions are critical for providing competitive customer experience in an e-commerce platform. An accurate and attractive description not only helps customers m…