computer vision

When Fish Look Alike: Tracking Identities with Dual-branch Elasticity

arXiv:2607.26412

summary

The paper introduces TIDE, a dual‑branch tracking system that forgoes heavy appearance models and instead uses adaptive geometric correspondence to track dense, homogeneous targets such as schooling fish, achieving competitive accuracy with much lower computational cost for edge deployment.

Abstract

Tracking dense, homogeneous targets like schooling fish remains a major challenge for multiple object tracking due to extreme inter-individual homogeneity, severe physical clustering, and rapid non-rigid deformations. While heavy-backbone separated detection and embedding trackers like SU-T push accuracy boundaries using complex Re-Identification networks, their computational overhead prohibits edge deployment. Furthermore, these modules often fail when appearance features degrade under severe occlusions. To overcome this, we propose Tracking Identities with Dual-branch Elasticity (TIDE). Bypassing expensive appearance cues, TIDE utilizes the Adaptive Geometric Correspondence IoU, an association mechanism leveraging spatial and structural consistency to robustly handle complex morphological variations. Crucially, TIDE introduces system-level deployment elasticity, decoupling the algorithmic pipeline from strict hardware constraints. Evaluations on the MFT-Edge benchmark demonstrate that our Lightweight L-branch achieves a competitive HOTA of 28.43 using merely 20.47G FLOPs. This represents a 38.7-fold computational reduction compared to upper bounds like SU-T, directly facilitating real-time edge deployment. Concurrently, our Scalable S-branch establishes a 29.98 HOTA, successfully bridging the gap between high-precision cloud analysis and efficient edge tracking. The dataset and codes are released at https://vranlee.github.io/TIDE/.

Topics & keywords

#multiple object tracking#edge computing#fish tracking#geometric correspondence#lightweight modelsdual-branch elasticityAdaptive Geometric Correspondence IoUHOTAFLOPs reductionreal-time tracking