28 citations · 42 across the 2 of their papers we have counts for
2 papers
cs.CL2021★ 28 cited
ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoders
Yan Song, Tong Zhang, Yonggang Wang +1
Pre-trained text encoders have drawn sustaining attention in natural language processing (NLP) and shown their capability in obtaining promising results in different tasks. Recent…
cs.CL2019★ 14 cited
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
Shizhe Diao, Jiaxin Bai, Yan Song +2
The pre-training of text encoders normally processes text as a sequence of tokens corresponding to small text units, such as word pieces in English and characters in Chinese. It om…