178 citations · 265 across the 3 of their papers we have counts for
3 papers
cs.CL2020★ 10 cited
Graph-based Multi-hop Reasoning for Long Text Generation
Liang Zhao, Jingjing Xu, Junyang Lin +3
Long text generation is an important but challenging task.The main problem lies in learning sentence-level semantic dependencies which traditional generative models often suffer fr…
cs.CL2019★ 77 cited
Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
Guangxiang Zhao, Junyang Lin, Zhiyuan Zhang +3
Self-attention based Transformer has demonstrated the state-of-the-art performances in a number of natural language processing tasks. Self-attention is able to model long-term depe…
cs.LG2019★ 178 cited
Understanding and Improving Layer Normalization
Jingjing Xu, Xu Sun, Zhiyuan Zhang +2
Layer normalization (LayerNorm) is a technique to normalize the distributions of intermediate layers. It enables smoother gradients, faster training, and better generalization accu…