53 citations · 107 across the 8 of their papers we have counts for
18 papers
LERT: A Linguistically-motivated Pre-trained Language Model
Yiming Cui, Wanxiang Che, Shijin Wang +1
Pre-trained Language Model (PLM) has become a representative foundation model in the natural language processing field. Most PLMs are trained with linguistic-agnostic pre-training…
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training
Ziqing Yang, Yiming Cui, Zhigang Chen +1
Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLM…
Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answering
Nan Shao, Yiming Cui, Ting Liu +2
Retrieving information from correlative paragraphs or documents to answer open-domain multi-hop questions is very challenging. To deal with this challenge, most of the existing wor…
Unsupervised Explanation Generation for Machine Reading Comprehension
Yiming Cui, Ting Liu, Shijin Wang +1
With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass hu…
CharBERT: Character-aware Pre-trained Language Model
Wentao Ma, Yiming Cui, Chenglei Si +3
Most pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations, by which OOV (out-of-vocab) words are almos…
Conversational Word Embedding for Retrieval-Based Dialog System
Wentao Ma, Yiming Cui, Ting Liu +3
Human conversations contain many types of information, e.g., knowledge, common sense, and language habits. In this paper, we propose a conversational word embedding method named PR…