Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey

Abstract

The rapid increase in the percentage of chronic disease patients along with the recent pandemic pose immediate threats on healthcare expenditure and elevate causes of death. This calls for transforming healthcare systems away from one-on-one patient treatment into intelligent health systems, to improve services, access and scalability, while reducing costs. Reinforcement Learning (RL) has witnessed an intrinsic breakthrough in solving a variety of complex problems for diverse applications and services. Thus, we conduct in this paper a comprehensive survey of the recent models and techniques of RL that have been developed/used for supporting Intelligent-healthcare (I-health) systems. This paper can guide the readers to deeply understand the state-of-the-art regarding the use of RL in the context of I-health. Specifically, we first present an overview for the I-health systems challenges, architecture, and how RL can benefit these systems. We then review the background and mathematical modeling of different RL, Deep RL (DRL), and multi-agent RL models. After that, we provide a deep literature review for the applications of RL in I-health systems. In particular, three main areas have been tackled, i.e., edge intelligence, smart core network, and dynamic treatment regimes. Finally, we highlight emerging challenges and outline future research directions in driving the future success of RL in I-health systems, which opens the door for exploring some interesting and unsolved problems.

References in corpus (10)

• A Brief Survey of Deep Reinforcement Learning
• Applications of Deep Learning and Reinforcement Learning to Biological Data
• Edge Computing For Smart Health: Context-aware Approaches, Opportunities, and Challenges
• Reinforcement Learning for IoT Security: A Comprehensive Survey
• Analysis and Optimal Edge Assignment For Hierarchical Federated Learning on Non-IID Data
• Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach
• R-MADDPG for Partially Observable Environments and Limited Communication
• Deep Reinforcement Learning for Sepsis Treatment
• A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks
• Robust Hybrid Learning for Estimating Personalized Dynamic Treatment Regimens