38 citations · 78 across the 11 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2023★ 23 cited
A Study on ReLU and Softmax in Transformer
Kai Shen, Junliang Guo, Xu Tan +3
The Transformer architecture consists of self-attention and feed-forward networks (FFNs) which can be viewed as key-value memories according to previous works. However, FFN and tra…
cs.CL2023
N-Gram Nearest Neighbor Machine Translation
Rui Lv, Junliang Guo, Rui Wang +3
Nearest neighbor machine translation augments the Autoregressive Translation~(AT) with -nearest-neighbor retrieval, by comparing the similarity between the token-level context r…
cs.CL2022
A Study of Syntactic Multi-Modality in Non-Autoregressive Machine Translation
Kexun Zhang, Rui Wang, Xu Tan +4
It is difficult for non-autoregressive translation (NAT) models to capture the multi-modal distribution of target translations due to their conditional independence assumption, whi…