Augmenting Sports Videos with VisCommentator
arXiv:2306.13491 · doi:10.1109/TVCG.2021.3114806
Abstract
Visualizing data in sports videos is gaining traction in sports analytics, given its ability to communicate insights and explicate player strategies engagingly. However, augmenting sports videos with such data visualizations is challenging, especially for sports analysts, as it requires considerable expertise in video editing. To ease the creation process, we present a design space that characterizes augmented sports videos at an element-level (what the constituents are) and clip-level (how those constituents are organized). We do so by systematically reviewing 233 examples of augmented sports videos collected from TV channels, teams, and leagues. The design space guides selection of data insights and visualizations for various purposes. Informed by the design space and close collaboration with domain experts, we design VisCommentator, a fast prototyping tool, to eases the creation of augmented table tennis videos by leveraging machine learning-based data extractors and design space-based visualization recommendations. With VisCommentator, sports analysts can create an augmented video by selecting the data to visualize instead of manually drawing the graphical marks. Our system can be generalized to other racket sports (e.g., tennis, badminton) once the underlying datasets and models are available. A user study with seven domain experts shows high satisfaction with our system, confirms that the participants can reproduce augmented sports videos in a short period, and provides insightful implications into future improvements and opportunities.
References in corpus (9)
- A Survey on Content-Aware Video Analysis for Sports
- Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline
- Towards Better Bus Networks: A Visual Analytics Approach
- A Visual Analytics Approach to Facilitate the Proctoring of Online Exams
- MARVisT: Authoring Glyph-based Visualization in Mobile Augmented Reality
- Augmenting Static Visualizations with PapARVis Designer
- EmoCo: Visual Analysis of Emotion Coherence in Presentation Videos
- EventAnchor: Reducing Human Interactions in Event Annotation of Racket Sports Videos
- Video-based Analysis of Soccer Matches
Cited by in corpus (13)
- iBall: Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations
- Sporthesia: Augmenting Sports Videos Using Natural Language
- GeoCamera: Telling Stories in Geographic Visualizations with Camera Movements
- ExpressEdit: Video Editing with Natural Language and Sketching
- Anchorage: Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events
- PoseCoach: A Customizable Analysis and Visualization System for Video-based Running Coaching
- avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality
- The Ball is in Our Court: Conducting Visualization Research with Sports Experts
- VideoPro: A Visual Analytics Approach for Interactive Video Programming
- RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual Effects
- User Experience of Visualizations in Motion: A Case Study and Design Considerations
- Reality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract Representations
- VIGMA: An Open-Access Framework for Visual Gait and Motion Analytics