Enhancing In-vehicle Multiple Object Tracking Systems with Embeddable Ising Machines
arXiv:2410.14093 · doi:10.1038/s41467-025-67282-7
Abstract
A cognitive function of tracking multiple objects, needed in autonomous mobile vehicles, comprises object detection and their temporal association. While great progress owing to machine learning has been recently seen for elaborating the similarity matrix between the objects that have been recognized and the objects detected in a current video frame, less for the assignment problem that finally determines the temporal association, which is a combinatorial optimization problem. Here we show an in-vehicle multiple object tracking system with a flexible assignment function for tracking through multiple long-term occlusion events. To solve the flexible assignment problem formulated as a nondeterministic polynomial time-hard problem, the system relies on an embeddable Ising machine based on a quantum-inspired algorithm called simulated bifurcation. Using a vehicle-mountable computing platform, we demonstrate a realtime system-wide throughput (23 frames per second on average) with the enhanced functionality.
18 pages, 7 figures, 2 tables
References in corpus (17)
- ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras
- Simple Online and Realtime Tracking
- Ising formulations of many NP problems
- A Survey of Autonomous Driving: Common Practices and Emerging Technologies
- FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
- MOT16: A Benchmark for Multi-Object Tracking
- HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking
- Quantum critical dynamics in a 5000-qubit programmable spin glass
- Bifurcation-based adiabatic quantum computation with a nonlinear oscillator network: Toward quantum soft computing
- Massively Parallel Probabilistic Computing with Sparse Ising Machines
- Optimized simulated annealing for Ising spin glasses
- Roadmap for Unconventional Computing with Nanotechnology
- Order-of-magnitude differences in computational performance of analog Ising machines induced by the choice of nonlinearity
- Simulated bifurcation for higher-order cost functions
- Correlation-diversified portfolio construction by finding maximum independent set in large-scale market graph
- Efficient and Scalable Architecture for Multiple-chip Implementation of Simulated Bifurcation Machines
- Pairs-trading System using Quantum-inspired Combinatorial Optimization Accelerator for Optimal Path Search in Market Graphs