Survey on reinforcement learning for language processing

Abstract

In recent years some researchers have explored the use of reinforcement learning (RL) algorithms as key components in the solution of various natural language processing tasks. For instance, some of these algorithms leveraging deep neural learning have found their way into conversational systems. This paper reviews the state of the art of RL methods for their possible use for different problems of natural language processing, focusing primarily on conversational systems, mainly due to their growing relevance. We provide detailed descriptions of the problems as well as discussions of why RL is well-suited to solve them. Also, we analyze the advantages and limitations of these methods. Finally, we elaborate on promising research directions in natural language processing that might benefit from reinforcement learning.

References in corpus (13)

• Sequence to Sequence Learning with Neural Networks
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Language Models are Few-Shot Learners
• Dual Learning for Machine Translation
• Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System
• Maximum-Likelihood Augmented Discrete Generative Adversarial Networks
• Long Text Generation via Adversarial Training with Leaked Information
• An Application of Reinforcement Learning to Dialogue Strategy Selection in a Spoken Dialogue System for Email
• Improving interactive reinforcement learning: What makes a good teacher?
• Plato Dialogue System: A Flexible Conversational AI Research Platform
• Distributed Structured Actor-Critic Reinforcement Learning for Universal Dialogue Management
• Interactive-Predictive Neural Machine Translation through Reinforcement and Imitation
• Document-editing Assistants and Model-based Reinforcement Learning as a Path to Conversational AI

Cited by in corpus (6)

• Survey of Hallucination in Natural Language Generation
• Neurosymbolic Reinforcement Learning and Planning: A Survey
• Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges
• A Safe Reinforcement Learning Algorithm for Supervisory Control of Power Plants
• A Survey on Personalized Content Synthesis with Diffusion Models
• A Mini Review on the utilization of Reinforcement Learning with OPC UA