A Short Survey On Memory Based Reinforcement Learning

Abstract

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL algorithms have been able to perform extremely well in sophisticated high-dimensional environments. However, even after successes in many domains, one of the major challenge in these approaches is the high magnitude of interactions with the environment required for efficient decision making. Seeking inspiration from the brain, this problem can be solved by incorporating instance based learning by biasing the decision making on the memories of high rewarding experiences. This paper reviews various recent reinforcement learning methods which incorporate external memory to solve decision making and a survey of them is presented. We provide an overview of the different methods - along with their advantages and disadvantages, applications and the standard experimentation settings used for memory based models. This review hopes to be a helpful resource to provide key insight of the recent advances in the field and provide help in further future development of it.

arXiv admin note: text overlap with arXiv:1803.10760, arXiv:1803.01846, arXiv:1702.08360, arXiv:1805.12375, arXiv:1507.06527, arXiv:1810.02274, arXiv:1711.06677 by other authors

References in corpus (13)

• Auto-Encoding Variational Bayes
• Sequence to Sequence Learning with Neural Networks
• Playing Atari with Deep Reinforcement Learning
• Trust Region Policy Optimization
• End-To-End Memory Networks
• Episodic Curiosity through Reachability
• Model-Free Episodic Control
• Unsupervised Predictive Memory in a Goal-Directed Agent
• Neural Map: Structured Memory for Deep Reinforcement Learning
• ViZDoom Competitions: Playing Doom from Pixels
• Neural Episodic Control
• Memory Augmented Control Networks
• Integrating Episodic Memory into a Reinforcement Learning Agent using Reservoir Sampling

Cited by in corpus (3)

• Levels of explainable artificial intelligence for human-aligned conversational explanations
• Probabilistic design of optimal sequential decision-making algorithms in learning and control
• D2RLIR : an improved and diversified ranking function in interactive recommendation systems based on deep reinforcement learning