Online Visual Robot Tracking and Identification using Deep LSTM Networks
arXiv:1810.04941
Abstract
Collaborative robots working on a common task are necessary for many applications. One of the challenges for achieving collaboration in a team of robots is mutual tracking and identification. We present a novel pipeline for online visionbased detection, tracking and identification of robots with a known and identical appearance. Our method runs in realtime on the limited hardware of the observer robot. Unlike previous works addressing robot tracking and identification, we use a data-driven approach based on recurrent neural networks to learn relations between sequential inputs and outputs. We formulate the data association problem as multiple classification problems. A deep LSTM network was trained on a simulated dataset and fine-tuned on small set of real data. Experiments on two challenging datasets, one synthetic and one real, which include long-term occlusions, show promising results.
arXiv commentIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, Canada, 2017. IROS RoboCup Best Paper Award
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
- YOLO9000: Better, Faster, Stronger
- Learning to Execute
- Backprop KF: Learning Discriminative Deterministic State Estimators
- End-to-End Tracking and Semantic Segmentation Using Recurrent Neural Networks
- A Monocular Vision System for Playing Soccer in Low Color Information Environments
- Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies
- Robust and Real-time Deep Tracking Via Multi-Scale Domain Adaptation