RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual Effects
arXiv:2405.17711 · doi:10.1145/3643834.3661631
Abstract
This paper introduces RealityEffects, a desktop authoring interface designed for editing and augmenting 3D volumetric videos with object-centric annotations and visual effects. RealityEffects enhances volumetric capture by introducing a novel method for augmenting captured physical motion with embedded, responsive visual effects, referred to as object-centric augmentation. In RealityEffects, users can interactively attach various visual effects to physical objects within the captured 3D scene, enabling these effects to dynamically move and animate in sync with the corresponding physical motion and body movements. The primary contribution of this paper is the development of a taxonomy for such object-centric augmentations, which includes annotated labels, highlighted objects, ghost effects, and trajectory visualization. This taxonomy is informed by an analysis of 120 edited videos featuring object-centric visual effects. The findings from our user study confirm that our direct manipulation techniques lower the barriers to editing and annotating volumetric captures, thereby enhancing interactive and engaging viewing experiences of 3D volumetric videos.
DIS 2024
References in corpus (9)
- Showing Academic Performance Predictions during Term Planning: Effects on Students' Decisions, Behaviors, and Preferences
- RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching
- SemanticPaint: A Framework for the Interactive Segmentation of 3D Scenes
- Augmenting Sports Videos with VisCommentator
- Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching
- Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI
- EventAnchor: Reducing Human Interactions in Event Annotation of Racket Sports Videos
- HoloBoard: a Large-format Immersive Teaching Board based on pseudo HoloGraphics
- RealityCanvas: Augmented Reality Sketching for Embedded and Responsive Scribble Animation Effects