Trading Off Diversity and Quality in Natural Language Generation

Abstract

For open-ended language generation tasks such as storytelling and dialogue, choosing the right decoding algorithm is critical to controlling the tradeoff between generation quality and diversity. However, there presently exists no consensus on which decoding procedure is best or even the criteria by which to compare them. We address these issues by casting decoding as a multi-objective optimization problem aiming to simultaneously maximize both response quality and diversity. Our framework enables us to perform the first large-scale evaluation of decoding methods along the entire quality-diversity spectrum. We find that when diversity is a priority, all methods perform similarly, but when quality is viewed as more important, the recently proposed nucleus sampling (Holtzman et al. 2019) outperforms all other evaluated decoding algorithms. Our experiments also confirm the existence of the `likelihood trap', the counter-intuitive observation that high likelihood sequences are often surprisingly low quality. We leverage our findings to create and evaluate an algorithm called \emph{selective sampling} which tractably approximates globally-normalized temperature sampling.

References in corpus (11)

• The Curious Case of Neural Text Degeneration
• Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge
• Towards a Human-like Open-Domain Chatbot
• Neural Text Generation with Unlikelihood Training
• Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
• Hierarchical Neural Story Generation
• Mutual Information and Diverse Decoding Improve Neural Machine Translation
• Analyzing Uncertainty in Neural Machine Translation
• Unifying Human and Statistical Evaluation for Natural Language Generation
• Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translation
• Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification

Cited by in corpus (5)

• Learning to summarize from human feedback
• Residual Energy-Based Models for Text
• Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity
• Learning Natural Language Generation from Scratch
• Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?