1 citations · 1 across the 4 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2022
Contextual Representation Learning beyond Masked Language Modeling
Zhiyi Fu, Wangchunshu Zhou, Jingjing Xu +2
How do masked language models (MLMs) such as BERT learn contextual representations? In this work, we analyze the learning dynamics of MLMs. We find that MLMs adopt sampled embeddin…
cs.CL2021
MTG: A Benchmark Suite for Multilingual Text Generation
Yiran Chen, Zhenqiao Song, Xianze Wu +5
We introduce MTG, a new benchmark suite for training and evaluating multilingual text generation. It is the first-proposed multilingual multiway text generation dataset with the la…
cs.CL2020
Rethinking Document-level Neural Machine Translation
Zewei Sun, Mingxuan Wang, Hao Zhou +4
This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the f…