Simultaneous Navigation and Construction Benchmarking Environments

Abstract

We need intelligent robots for mobile construction, the process of navigating in an environment and modifying its structure according to a geometric design. In this task, a major robot vision and learning challenge is how to exactly achieve the design without GPS, due to the difficulty caused by the bi-directional coupling of accurate robot localization and navigation together with strategic environment manipulation. However, many existing robot vision and learning tasks such as visual navigation and robot manipulation address only one of these two coupled aspects. To stimulate the pursuit of a generic and adaptive solution, we reasonably simplify mobile construction as a partially observable Markov decision process (POMDP) in 1/2/3D grid worlds and benchmark the performance of a handcrafted policy with basic localization and planning, and state-of-the-art deep reinforcement learning (RL) methods. Our extensive experiments show that the coupling makes this problem very challenging for those methods, and emphasize the need for novel task-specific solutions.

References in corpus (11)

• Playing Atari with Deep Reinforcement Learning
• Dueling Network Architectures for Deep Reinforcement Learning
• Human-level performance in first-person multiplayer games with population-based deep reinforcement learning
• Deep Recurrent Q-Learning for Partially Observable MDPs
• Soft Actor-Critic for Discrete Action Settings
• Control of Memory, Active Perception, and Action in Minecraft
• Playing FPS Games with Deep Reinforcement Learning
• TorchCraft: a Library for Machine Learning Research on Real-Time Strategy Games
• The AdobeIndoorNav Dataset: Towards Deep Reinforcement Learning based Real-world Indoor Robot Visual Navigation
• REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning
• Robotic positioning device for three-dimensional printing