30 citations · 148 across the 82 of their papers we have counts for
10 papers · 1 filter
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
Haojie Pan, Chengyu Wang, Minghui Qiu +3
Pre-trained language models have been applied to various NLP tasks with considerable performance gains. However, the large model sizes, together with the long inference time, limit…
Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations
Haojie Pan, Cen Chen, Chengyu Wang +4
Information-seeking conversation systems are increasingly popular in real-world applications, especially for e-commerce companies. To retrieve appropriate responses for users, it i…
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
Minghui Qiu, Peng Li, Chengyu Wang +8
The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP)…
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
Yiwu Yao, Yuchao Li, Chengyu Wang +8
The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices. In this paper, we present a novel quantized Winograd op…
EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition
Chengyu Wang, Mengli Cheng, Xu Hu +1
We present EasyASR, a distributed machine learning platform for training and serving large-scale Automatic Speech Recognition (ASR) models, as well as collecting and processing aud…
Weakly Supervised Construction of ASR Systems with Massive Video Data
Mengli Cheng, Chengyu Wang, Xu Hu +2
Building Automatic Speech Recognition (ASR) systems from scratch is significantly challenging, mostly due to the time-consuming and financially-expensive process of annotating a la…
Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources
Taolin Zhang, Chengyu Wang, Minghui Qiu +3
Machine Reading Comprehension (MRC) aims to extract answers to questions given a passage. It has been widely studied recently, especially in open domains. However, few efforts have…
Transformer-XL Based Music Generation with Multiple Sequences of Time-valued Notes
Xianchao Wu, Chengyuan Wang, Qinying Lei
Current state-of-the-art AI based classical music creation algorithms such as Music Transformer are trained by employing single sequence of notes with time-shifts. The major drawba…
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining
Chengyu Wang, Minghui Qiu, Jun Huang +1
Pre-trained neural language models bring significant improvement for various NLP tasks, by fine-tuning the models on task-specific training sets. During fine-tuning, the parameters…
KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
Chengyu Wang, Minghui Qiu, Jun Huang +1
Lexical relations describe how concepts are semantically related, in the form of relation triples. The accurate prediction of lexical relations between concepts is challenging, due…