Enhancing Multi-Robot Perception via Learned Data Association
arXiv:2107.00769
Abstract
In this paper, we address the multi-robot collaborative perception problem, specifically in the context of multi-view infilling for distributed semantic segmentation. This setting entails several real-world challenges, especially those relating to unregistered multi-agent image data. Solutions must effectively leverage multiple, non-static, and intermittently-overlapping RGB perspectives. To this end, we propose the Multi-Agent Infilling Network: an extensible neural architecture that can be deployed (in a distributed manner) to each agent in a robotic swarm. Specifically, each robot is in charge of locally encoding and decoding visual information, and an extensible neural mechanism allows for an uncertainty-aware and context-based exchange of intermediate features. We demonstrate improved performance on a realistic multi-robot AirSim dataset.
arXiv commentAccepted to ICRA 2020 Workshop on "Emerging Learning and Algorithmic Methods for Data Association in Robotics"; associated spotlight talk available at https://www.youtube.com/watch?v=-lEVvtsfz0I&t=16743s
References in corpus (6)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
- FlowNet: Learning Optical Flow with Convolutional Networks
- Deep Image Homography Estimation
- Toward Geometric Deep SLAM
- EMPNet: Neural Localisation and Mapping Using Embedded Memory Points