Dual Inference for Improving Language Understanding and Generation
arXiv:2010.04246
Abstract
Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. The prior work mainly focused on exploiting the duality in model training in order to obtain the models with better performance. However, regarding the fast-growing scale of models in the current NLP area, sometimes we may have difficulty retraining whole NLU and NLG models. To better address the issue, this paper proposes to leverage the duality in the inference stage without the need of retraining. The experiments on three benchmark datasets demonstrate the effectiveness of the proposed method in both NLU and NLG, providing the great potential of practical usage.
arXiv commentPublished in Findings of EMNLP 2020. The first two authors contributed to this paper equally
References in corpus (5)
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Language Models are Few-Shot Learners
- Dual Learning for Machine Translation
- MADE: Masked Autoencoder for Distribution Estimation
- Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces