PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search
arXiv:2403.15712 · doi:10.1109/LRA.2024.3379865
Abstract
Multiple object tracking is a critical task in autonomous driving. Existing works primarily focus on the heuristic design of neural networks to obtain high accuracy. As tracking accuracy improves, however, neural networks become increasingly complex, posing challenges for their practical application in real driving scenarios due to the high level of latency. In this paper, we explore the use of the neural architecture search (NAS) methods to search for efficient architectures for tracking, aiming for low real-time latency while maintaining relatively high accuracy. Another challenge for object tracking is the unreliability of a single sensor, therefore, we propose a multi-modal framework to improve the robustness. Experiments demonstrate that our algorithm can run on edge devices within lower latency constraints, thus greatly reducing the computational requirements for multi-modal object tracking while keeping lower latency.
arXiv commentIEEE Robotics and Automation Letters 2024. Code is available at https://github.com/PholyPeng/PNAS-MOT
References in corpus (6)
- Neural Architecture Search with Reinforcement Learning
- Tracking without bells and whistles
- End-to-end Learning of Multi-sensor 3D Tracking by Detection
- Track to Reconstruct and Reconstruct to Track
- Vehicle Tracking Using Surveillance with Multimodal Data Fusion
- Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation