Object Goal Navigation using Goal-Oriented Semantic Exploration

Abstract

This work studies the problem of object goal navigation which involves navigating to an instance of the given object category in unseen environments. End-to-end learning-based navigation methods struggle at this task as they are ineffective at exploration and long-term planning. We propose a modular system called, `Goal-Oriented Semantic Exploration' which builds an episodic semantic map and uses it to explore the environment efficiently based on the goal object category. Empirical results in visually realistic simulation environments show that the proposed model outperforms a wide range of baselines including end-to-end learning-based methods as well as modular map-based methods and led to the winning entry of the CVPR-2020 Habitat ObjectNav Challenge. Ablation analysis indicates that the proposed model learns semantic priors of the relative arrangement of objects in a scene, and uses them to explore efficiently. Domain-agnostic module design allow us to transfer our model to a mobile robot platform and achieve similar performance for object goal navigation in the real-world.

Winner of the CVPR 2020 AI-Habitat Object Goal Navigation Challenge. See the project webpage at https://devendrachaplot.github.io/projects/semantic-exploration.html

References in corpus (10)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• Learning to Navigate in Complex Environments
• Matterport3D: Learning from RGB-D Data in Indoor Environments
• Learning to Explore using Active Neural SLAM
• MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
• Grounded Language Learning in a Simulated 3D World
• Neural Map: Structured Memory for Deep Reinforcement Learning
• Gated-Attention Architectures for Task-Oriented Language Grounding
• PyRobot: An Open-source Robotics Framework for Research and Benchmarking
• DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames