39 citations · 325 across the 35 of their papers we have counts for
7 papers · 1 filter
Unsupervised Neural Dialect Translation with Commonality and Diversity Modeling
Yu Wan, Baosong Yang, Derek F. Wong +3
As a special machine translation task, dialect translation has two main characteristics: 1) lack of parallel training corpus; and 2) possessing similar grammar between two sides of…
Neuron Interaction Based Representation Composition for Neural Machine Translation
Jian Li, Xing Wang, Baosong Yang +3
Recent NLP studies reveal that substantial linguistic information can be attributed to single neurons, i.e., individual dimensions of the representation vectors. We hypothesize tha…
Assessing the Ability of Self-Attention Networks to Learn Word Order
Baosong Yang, Longyue Wang, Derek F. Wong +2
Self-attention networks (SAN) have attracted a lot of interests due to their high parallelization and strong performance on a variety of NLP tasks, e.g. machine translation. Due to…
Convolutional Self-Attention Networks
Baosong Yang, Longyue Wang, Derek Wong +2
Self-attention networks (SANs) have drawn increasing interest due to their high parallelization in computation and flexibility in modeling dependencies. SANs can be further enhance…
Information Aggregation for Multi-Head Attention with Routing-by-Agreement
Jian Li, Baosong Yang, Zi-Yi Dou +3
Multi-head attention is appealing for its ability to jointly extract different types of information from multiple representation subspaces. Concerning the information aggregation,…
Modeling Recurrence for Transformer
Jie Hao, Xing Wang, Baosong Yang +3
Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal…