Next-Best-View Estimation based on Deep Reinforcement Learning for Active Object Classification
arXiv:2110.06766
Abstract
The presentation and analysis of image data from a single viewpoint are often not sufficient to solve a task. Several viewpoints are necessary to obtain more information. The next-best-view problem attempts to find the optimal viewpoint with the greatest information gain for the underlying task. In this work, a robot arm holds an object in its end-effector and searches for a sequence of next-best-view to explicitly identify the object. We use Soft Actor-Critic (SAC), a method of deep reinforcement learning, to learn these next-best-views for a specific set of objects. The evaluation shows that an agent can learn to determine an object pose to which the robot arm should move an object. This leads to a viewpoint that provides a more accurate prediction to distinguish such an object from other objects better. We make the code publicly available for the scientific community and for reproducibility.
arXiv comment9 pages, 11 figures, 4 tables, preprint, Github repo: https://github.com/ckorbach/nbv_rl
References in corpus (5)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Soft Actor-Critic Algorithms and Applications
- Supervised Learning of the Next-Best-View for 3D Object Reconstruction
- Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd
- Active 6D Multi-Object Pose Estimation in Cluttered Scenarios with Deep Reinforcement Learning