Landmark Policy Optimization for Object Navigation Task
arXiv:2109.09512
Abstract
This work studies object goal navigation task, which involves navigating to the closest object related to the given semantic category in unseen environments. Recent works have shown significant achievements both in the end-to-end Reinforcement Learning approach and modular systems, but need a big step forward to be robust and optimal. We propose a hierarchical method that incorporates standard task formulation and additional area knowledge as landmarks, with a way to extract these landmarks. In a hierarchy, a low level consists of separately trained algorithms to the most intuitive skills, and a high level decides which skill is needed at this moment. With all proposed solutions, we achieve a 0.75 success rate in a realistic Habitat simulator. After a small stage of additional model training in a reconstructed virtual area at a simulator, we successfully confirmed our results in a real-world case.
References in corpus (9)
- Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
- Dota 2 with Large Scale Deep Reinforcement Learning
- Joint 2D-3D-Semantic Data for Indoor Scene Understanding
- SOLOv2: Dynamic and Fast Instance Segmentation
- AI2-THOR: An Interactive 3D Environment for Visual AI
- Object Goal Navigation using Goal-Oriented Semantic Exploration
- MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
- ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects
- Auxiliary Tasks and Exploration Enable ObjectNav