Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey

Abstract

The rapid increase in the percentage of chronic disease patients along with the recent pandemic pose immediate threats on healthcare expenditure and elevate causes of death. This calls for transforming healthcare systems away from one-on-one patient treatment into intelligent health systems, to improve services, access and scalability, while reducing costs. Reinforcement Learning (RL) has witnessed an intrinsic breakthrough in solving a variety of complex problems for diverse applications and services. Thus, we conduct in this paper a comprehensive survey of the recent models and techniques of RL that have been developed/used for supporting Intelligent-healthcare (I-health) systems. This paper can guide the readers to deeply understand the state-of-the-art regarding the use of RL in the context of I-health. Specifically, we first present an overview for the I-health systems challenges, architecture, and how RL can benefit these systems. We then review the background and mathematical modeling of different RL, Deep RL (DRL), and multi-agent RL models. After that, we provide a deep literature review for the applications of RL in I-health systems. In particular, three main areas have been tackled, i.e., edge intelligence, smart core network, and dynamic treatment regimes. Finally, we highlight emerging challenges and outline future research directions in driving the future success of RL in I-health systems, which opens the door for exploring some interesting and unsolved problems.

References in corpus (28)

• Continuous control with deep reinforcement learning
• Playing Atari with Deep Reinforcement Learning
• A Brief Survey of Deep Reinforcement Learning
• Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applications
• Learning to Communicate with Deep Multi-Agent Reinforcement Learning
• Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
• Benchmarking Deep Reinforcement Learning for Continuous Control
• Applications of Deep Learning and Reinforcement Learning to Biological Data
• A Survey and Critique of Multiagent Deep Reinforcement Learning
• Deep Reinforcement Learning for Cyber Security
• Deep Reinforcement Learning: An Overview
• Edge Computing For Smart Health: Context-aware Approaches, Opportunities, and Challenges
• Reinforcement Learning for IoT Security: A Comprehensive Survey
• Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach
• Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
• Analysis and Optimal Edge Assignment For Hierarchical Federated Learning on Non-IID Data
• Deep Deterministic Policy Gradient for Urban Traffic Light Control
• Reinforcement Learning in Healthcare: A Survey
• Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach
• Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
• Towards 5G Enabled Tactile Robotic Telesurgery
• R-MADDPG for Partially Observable Environments and Limited Communication
• Deep Reinforcement Learning for Sepsis Treatment
• A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks
• Robust Hybrid Learning for Estimating Personalized Dynamic Treatment Regimens
• The Actor Search Tree Critic (ASTC) for Off-Policy POMDP Learning in Medical Decision Making
• Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive, personalized multi-cytokine therapy for sepsis
• Deep Learning for Radio Resource Allocation in Multi-Cell Networks