166 citations · 625 across the 30 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CL2019★ 1 cited
Neuron Interaction Based Representation Composition for Neural Machine Translation
Jian Li, Xing Wang, Baosong Yang +3
Recent NLP studies reveal that substantial linguistic information can be attributed to single neurons, i.e., individual dimensions of the representation vectors. We hypothesize tha…
cs.CL2019★ 13 cited
Information Aggregation for Multi-Head Attention with Routing-by-Agreement
Jian Li, Baosong Yang, Zi-Yi Dou +3
Multi-head attention is appealing for its ability to jointly extract different types of information from multiple representation subspaces. Concerning the information aggregation,…
cs.CL2019★ 28 cited
Context-Aware Self-Attention Networks
Baosong Yang, Jian Li, Derek Wong +3
Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the depende…