1.2k citations
Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
- Harbin Institute of TechnologyCN15 papers
- University of Science and Technology of ChinaCN14 papers
- University of SurreyGB3 papers
- Ant Group (China)CN2 papers
- Association for Computing MachineryUS2 papers
- Fudan UniversityCN2 papers
- North China Institute of Aerospace EngineeringCN2 papers
- Peking UniversityCN2 papers
- Queen's UniversityCA2 papers
- Samsung (United Kingdom)GB2 papers
- University of Maryland, College ParkUS2 papers
- University of OttawaCA2 papers
26 papers · 1 filter
Reducing the gap between streaming and non-streaming Transducer-based ASR by adaptive two-stage knowledge distillation
Haitao Tang, Yu Fu, Lei Sun +8
Transducer is one of the mainstream frameworks for streaming speech recognition. There is a performance gap between the streaming and non-streaming transducer models due to limited…
JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understanding
Wayne Xin Zhao, Kun Zhou, Zheng Gong +7
This paper aims to advance the mathematical intelligence of machines by presenting the first Chinese mathematical pre-trained language model~(PLM) for effectively understanding and…
USTC-NELSLIP at SemEval-2022 Task 11: Gazetteer-Adapted Integration Network for Multilingual Complex Named Entity Recognition
Beiduo Chen, Jun-Yu Ma, Jiajun Qi +3
This paper describes the system developed by the USTC-NELSLIP team for SemEval-2022 Task 11 Multilingual Complex Named Entity Recognition (MultiCoNER). We propose a gazetteer-adapt…
Multilingual Multi-Aspect Explainability Analyses on Machine Reading Comprehension Models
Yiming Cui, Wei-Nan Zhang, Wanxiang Che +3
Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs).…
Bilingual Alignment Pre-Training for Zero-Shot Cross-Lingual Transfer
Ziqing Yang, Wentao Ma, Yiming Cui +3
Multilingual pre-trained models have achieved remarkable performance on cross-lingual transfer learning. Some multilingual models such as mBERT, have been pre-trained on unlabeled…
ExpMRC: Explainability Evaluation for Machine Reading Comprehension
Yiming Cui, Ting Liu, Wanxiang Che +2
Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). How…
CharBERT: Character-aware Pre-trained Language Model
Wentao Ma, Yiming Cui, Chenglei Si +3
Most pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations, by which OOV (out-of-vocab) words are almos…
Conversational Word Embedding for Retrieval-Based Dialog System
Wentao Ma, Yiming Cui, Ting Liu +3
Human conversations contain many types of information, e.g., knowledge, common sense, and language habits. In this paper, we propose a conversational word embedding method named PR…
Benchmarking Robustness of Machine Reading Comprehension Models
Chenglei Si, Ziqing Yang, Yiming Cui +3
Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with ne…
Revisiting Pre-Trained Models for Chinese Natural Language Processing
Yiming Cui, Wanxiang Che, Ting Liu +3
Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further imp…
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Jia-Chen Gu, Tianda Li, Quan Liu +4
In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (S…
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
Yiming Cui, Ting Liu, Ziqing Yang +5
Owing to the continuous efforts by the Chinese NLP community, more and more Chinese machine reading comprehension datasets become available. To add diversity in this area, in this…
Is Graph Structure Necessary for Multi-hop Question Answering?
Nan Shao, Yiming Cui, Ting Liu +2
Recently, attempting to model texts as graph structure and introducing graph neural networks to deal with it has become a trend in many NLP research areas. In this paper, we invest…
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing
Ziqing Yang, Yiming Cui, Zhipeng Chen +4
In this paper, we introduce TextBrewer, an open-source knowledge distillation toolkit designed for natural language processing. It works with different neural network models and su…
Discriminative Sentence Modeling for Story Ending Prediction
Yiming Cui, Wanxiang Che, Wei-Nan Zhang +3
Story Ending Prediction is a task that needs to select an appropriate ending for the given story, which requires the machine to understand the story and sometimes needs commonsense…
Cross-Lingual Machine Reading Comprehension
Yiming Cui, Wanxiang Che, Ting Liu +3
Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few effor…
Pre-Training with Whole Word Masking for Chinese BERT
Yiming Cui, Wanxiang Che, Ting Liu +2
Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and its consecutive variants have been proposed to further…
Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
Jia-Chen Gu, Zhen-Hua Ling, Quan Liu
In this paper, we propose an interactive matching network (IMN) for the multi-turn response selection task. First, IMN constructs word representations from three aspects to address…
Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions
Zhipeng Chen, Yiming Cui, Wentao Ma +2
Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper,…
Spelling Error Correction Using a Nested RNN Model and Pseudo Training Data
Hao Li, Yang Wang, Xinyu Liu +2
We propose a nested recurrent neural network (nested RNN) model for English spelling error correction and generate pseudo data based on phonetic similarity to train it. The model f…
Medical Exam Question Answering with Large-scale Reading Comprehension
Xiao Zhang, Ji Wu, Zhiyang He +2
Reading and understanding text is one important component in computer aided diagnosis in clinical medicine, also being a major research problem in the field of NLP. In this work, w…
Neural Natural Language Inference Models Enhanced with External Knowledge
Qian Chen, Xiaodan Zhu, Zhen-Hua Ling +2
Modeling natural language inference is a very challenging task. With the availability of large annotated data, it has recently become feasible to train complex models such as neura…
Enhanced LSTM for Natural Language Inference
Qian Chen, Xiaodan Zhu, Zhenhua Ling +3
Reasoning and inference are central to human and artificial intelligence. Modeling inference in human language is very challenging. With the availability of large annotated data (B…
Generating and Exploiting Large-scale Pseudo Training Data for Zero Pronoun Resolution
Ting Liu, Yiming Cui, Qingyu Yin +3
Most existing approaches for zero pronoun resolution are heavily relying on annotated data, which is often released by shared task organizers. Therefore, the lack of annotated data…