103 citations · 143 across the 9 of their papers we have counts for
4 papers · 1 filter
Memformer: A Memory-Augmented Transformer for Sequence Modeling
Qingyang Wu, Zhenzhong Lan, Kun Qian +3
Transformers have reached remarkable success in sequence modeling. However, these models have efficiency issues as they need to store all the history token-level representations as…
Perception Score, A Learned Metric for Open-ended Text Generation Evaluation
Jing Gu, Qingyang Wu, Zhou Yu
Automatic evaluation for open-ended natural language generation tasks remains a challenge. Existing metrics such as BLEU show a low correlation with human judgment. We propose a no…
A Tailored Pre-Training Model for Task-Oriented Dialog Generation
Jing Gu, Qingyang Wu, Chongruo Wu +2
The recent success of large pre-trained language models such as BERT and GPT-2 has suggested the effectiveness of incorporating language priors in downstream dialog generation task…
Data Annealing for Informal Language Understanding Tasks
Jing Gu, Zhou Yu
There is a huge performance gap between formal and informal language understanding tasks. The recent pre-trained models that improved the performance of formal language understandi…