Spatial Intention Maps for Multi-Agent Mobile Manipulation

Abstract

The ability to communicate intention enables decentralized multi-agent robots to collaborate while performing physical tasks. In this work, we present spatial intention maps, a new intention representation for multi-agent vision-based deep reinforcement learning that improves coordination between decentralized mobile manipulators. In this representation, each agent's intention is provided to other agents, and rendered into an overhead 2D map aligned with visual observations. This synergizes with the recently proposed spatial action maps framework, in which state and action representations are spatially aligned, providing inductive biases that encourage emergent cooperative behaviors requiring spatial coordination, such as passing objects to each other or avoiding collisions. Experiments across a variety of multi-agent environments, including heterogeneous robot teams with different abilities (lifting, pushing, or throwing), show that incorporating spatial intention maps improves performance for different mobile manipulation tasks while significantly enhancing cooperative behaviors.

arXiv commentTo appear at IEEE International Conference on Robotics and Automation (ICRA), 2021. Project page: https://spatial-intention-maps.cs.princeton.edu/

References in corpus (11)

• Learning to Communicate with Deep Multi-Agent Reinforcement Learning
• Human-level performance in first-person multiplayer games with population-based deep reinforcement learning
• A Survey and Critique of Multiagent Deep Reinforcement Learning
• Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solver
• Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
• Emergent Tool Use From Multi-Agent Autocurricula
• Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement Learning
• Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
• Spatial Action Maps for Mobile Manipulation
• Multi-Agent Collaboration via Reward Attribution Decomposition
• Model-based Reinforcement Learning for Decentralized Multiagent Rendezvous

Cited by in corpus (2)

• VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objects
• Tool as Embodiment for Recursive Manipulation