Reinforcement Learning: A Survey

Abstract

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of current work are summarized. Reinforcement learning is the problem faced by an agent that learns behavior through trial-and-error interactions with a dynamic environment. The work described here has a resemblance to work in psychology, but differs considerably in the details and in the use of the word ``reinforcement.'' The paper discusses central issues of reinforcement learning, including trading off exploration and exploitation, establishing the foundations of the field via Markov decision theory, learning from delayed reinforcement, constructing empirical models to accelerate learning, making use of generalization and hierarchy, and coping with hidden state. It concludes with a survey of some implemented systems and an assessment of the practical utility of current methods for reinforcement learning.

See http://www.jair.org/ for any accompanying files

References in corpus (1)

• On the Complexity of Solving Markov Decision Problems

Cited by in corpus (16)

• Optimal control towards sustainable wastewater treatment plants based on multi-agent reinforcement learning
• Verification for Machine Learning, Autonomy, and Neural Networks Survey
• Robust Android Malware Detection System against Adversarial Attacks using Q-Learning
• A Review of Machine Learning Applications in Fuzzing
• AutoPhase: Juggling HLS Phase Orderings in Random Forests with Deep Reinforcement Learning
• A View on Deep Reinforcement Learning in System Optimization
• Machine Learning enables Design of On-chip Integrated Silicon T-junctions with footprint of 1.2 $\mu$m x 1.2 $\mu$m
• Reward Guidance for Reinforcement Learning Tasks Based on Large Language Models: The LMGT Framework
• Towards VM Rescheduling Optimization Through Deep Reinforcement Learning
• Strategic Attack & Defense in Security Diffusion Games
• Designing high-fidelity multi-qubit gates for semiconductor quantum dots through deep reinforcement learning
• A Game-Theoretic Framework for Decentralized Cooperative Data Exchange using Network Coding
• AutoPhase: Compiler Phase-Ordering for High Level Synthesis with Deep Reinforcement Learning
• Experimental semi-autonomous eigensolver using reinforcement learning
• Solving The Lunar Lander Problem under Uncertainty using Reinforcement Learning
• Medical Vision Language Models as Policies for Robotic Surgery