Partially Observable Markov Decision Processes in Robotics: A Survey
arXiv:2209.10342 · doi:10.1109/TRO.2022.3200138
Abstract
Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and solving robot decision and control tasks under uncertainty. Over the last decade, it has seen many successful applications, spanning localization and navigation, search and tracking, autonomous driving, multi-robot systems, manipulation, and human-robot interaction. This survey aims to bridge the gap between the development of POMDP models and algorithms at one end and application to diverse robot decision tasks at the other. It analyzes the characteristics of these tasks and connects them with the mathematical and algorithmic properties of the POMDP framework for effective modeling and solution. For practitioners, the survey provides some of the key task characteristics in deciding when and how to apply POMDPs to robot tasks successfully. For POMDP algorithm designers, the survey provides new insights into the unique challenges of applying POMDPs to robot systems and points to promising new directions for further research.
arXiv comment20 pages, 10 figures. Author version of paper. Accepted for publication in IEEE Transactions on Robotics
References in corpus (16)
- A Survey of Deep Learning Techniques for Autonomous Driving
- Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model
- Data-Driven Grasp Synthesis - A Survey
- Value-Function Approximations for Partially Observable Markov Decision Processes
- Online Planning Algorithms for POMDPs
- Anytime Point-Based Approximations for Large POMDPs
- Perseus: Randomized Point-based Value Iteration for POMDPs
- Bayesian Reinforcement Learning: A Survey
- MAA*: A Heuristic Search Algorithm for Solving Decentralized POMDPs
- Planning for robotic exploration based on forward simulation
- Exploiting Submodular Value Functions For Scaling Up Active Perception
- A Decision-theoretic Approach to Detection-based Target Search with a UAV
- Bounded Policy Synthesis for POMDPs with Safe-Reachability Objectives
- Autonomous Vehicle Speed Control for Safe Navigation of Occluded Pedestrian Crosswalk
- POMP: Pomcp-based Online Motion Planning for active visual search in indoor environments
- Multi-Resolution POMDP Planning for Multi-Object Search in 3D
Cited by in corpus (4)
- Adaptive Robotic Information Gathering via Non-Stationary Gaussian Processes
- Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review
- High-Precision and High-Efficiency Trajectory Tracking for Excavators Based on Closed-Loop Dynamics
- A distributed motion planning approach to cooperative underwater acoustic source tracking