TrackID3x3: A Dataset and Algorithm for Multi-Player Tracking with Identification and Pose Estimation in 3x3 Basketball Full-court Videos
arXiv:2503.18282 · doi:10.1145/3728423.3759400
Abstract
Multi-object tracking, player identification, and pose estimation are fundamental components of sports analytics, essential for analyzing player movements, performance, and tactical strategies. However, existing datasets and methodologies primarily target mainstream team sports such as soccer and conventional 5-on-5 basketball, often overlooking scenarios involving fixed-camera setups commonly used at amateur levels, less mainstream sports, or datasets that explicitly incorporate pose annotations. In this paper, we propose the TrackID3x3 dataset, the first publicly available comprehensive dataset specifically designed for multi-player tracking, player identification, and pose estimation in 3x3 basketball scenarios. The dataset comprises three distinct subsets (Indoor fixed-camera, Outdoor fixed-camera, and Drone camera footage), capturing diverse full-court camera perspectives and environments. We also introduce the Track-ID task, a simplified variant of the game state reconstruction task that excludes field detection and focuses exclusively on fixed-camera scenarios. To evaluate performance, we propose a baseline algorithm called Track-ID algorithm, tailored to assess tracking and identification quality. Furthermore, our benchmark experiments, utilizing recent multi-object tracking algorithms (e.g., BoT-SORT-ReID) and top-down pose estimation methods (HRNet, RTMPose, and SwinPose), demonstrate robust results and highlight remaining challenges. Our dataset and evaluation benchmarks provide a solid foundation for advancing automated analytics in 3x3 basketball. Dataset and code will be available at https://github.com/open-starlab/TrackID3x3.
Accepted in MMSports'25
References in corpus (11)
- Simple Online and Realtime Tracking
- DeepPose: Human Pose Estimation via Deep Neural Networks
- YOLOX: Exceeding YOLO Series in 2021
- ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation
- SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos
- DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotations
- Evaluation of soccer team defense based on prediction models of ball recovery and being attacked: A pilot study
- Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning
- Multi-task Learning for Joint Re-identification, Team Affiliation, and Role Classification for Sports Visual Tracking
- Decentralized policy learning with partial observation and mechanical constraints for multiperson modeling
- Estimation of control area in badminton doubles with pose information from top and back view drone videos