25 citations · 40 across the 9 of their papers we have counts for
10 papers
Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization
Xinran Chen, Sufeng Duan, Gongshen Liu
Being one of the IR-NAT (Iterative-refinemennt-based NAT) frameworks, the Conditional Masked Language Model (CMLM) adopts the mask-predict paradigm to re-predict the masked low-con…
Multi-grained Evidence Inference for Multi-choice Reading Comprehension
Yilin Zhao, Hai Zhao, Sufeng Duan
Multi-choice Machine Reading Comprehension (MRC) is a major and challenging task for machines to answer questions according to provided options. Answers in multi-choice MRC cannot…
SG-Net: Syntax Guided Transformer for Language Representation
Zhuosheng Zhang, Yuwei Wu, Junru Zhou +3
Understanding human language is one of the key themes of artificial intelligence. For language representation, the capacity of effectively modeling the linguistic knowledge from th…
To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph
Sufeng Duan, Hai Zhao
In this paper, we propose an explanation of representation for self-attention network (SAN) based neural sequence encoders, which regards the information captured by the model and…
Graph-to-Sequence Neural Machine Translation
Sufeng Duan, Hai Zhao, Rui Wang
Neural machine translation (NMT) usually works in a seq2seq learning way by viewing either source or target sentence as a linear sequence of words, which can be regarded as a speci…
Capsule-Transformer for Neural Machine Translation
Sufeng Duan, Juncheng Cao, Hai Zhao
Transformer hugely benefits from its key design of the multi-head self-attention network (SAN), which extracts information from various perspectives through transforming the given…