57 citations · 289 across the 34 of their papers we have counts for
34 papers
Universal Multimodal Representation for Language Understanding
Zhuosheng Zhang, Kehai Chen, Rui Wang +4
Representation learning is the foundation of natural language processing (NLP). This work presents new methods to employ visual information as assistant signals to general NLP task…
Language Model Pre-training on True Negatives
Zhuosheng Zhang, Hai Zhao, Masao Utiyama +1
Discriminative pre-trained language models (PLMs) learn to predict original texts from intentionally corrupted ones. Taking the former text as positive and the latter as negative s…
Smoothing Dialogue States for Open Conversational Machine Reading
Zhuosheng Zhang, Siru Ouyang, Hai Zhao +2
Conversational machine reading (CMR) requires machines to communicate with humans through multi-turn interactions between two salient dialogue states of decision making and questio…
Cross-lingual Transferring of Pre-trained Contextualized Language Models
Zuchao Li, Kevin Parnow, Hai Zhao +4
Though the pre-trained contextualized language model (PrLM) has made a significant impact on NLP, training PrLMs in languages other than English can be impractical for two reasons:…
User-Generated Text Corpus for Evaluating Japanese Morphological Analysis and Lexical Normalization
Shohei Higashiyama, Masao Utiyama, Taro Watanabe +1
Morphological analysis (MA) and lexical normalization (LN) are both important tasks for Japanese user-generated text (UGT). To evaluate and compare different MA/LN systems, we have…
Text Compression-aided Transformer Encoding
Zuchao Li, Zhuosheng Zhang, Hai Zhao +4
Text encoding is one of the most important steps in Natural Language Processing (NLP). It has been done well by the self-attention mechanism in the current state-of-the-art Transfo…