Augmented Chironomia for Presenting Data to Remote Audiences
arXiv:2208.04451 · doi:10.1145/3526113.3545614
Abstract
To facilitate engaging and nuanced conversations around data, we contribute a touchless approach to interacting directly with visualization in remote presentations. We combine dynamic charts overlaid on a presenter's webcam feed with continuous bimanual hand tracking, demonstrating interactions that highlight and manipulate chart elements appearing in the foreground. These interactions are simultaneously functional and deictic, and some allow for the addition of "rhetorical flourish", or expressive movement used when speaking about quantities, categories, and time intervals. We evaluated our approach in two studies with professionals who routinely deliver and attend presentations about data. The first study considered the presenter perspective, where 12 participants delivered presentations to a remote audience using a presentation environment incorporating our approach. The second study considered the audience experience of 17 participants who attended presentations supported by our environment. Finally, we reflect on observations from these studies and discuss related implications for engaging remote audiences in conversations about data.
arXiv commentTo appear at the 2022 ACM Symposium on User Interface Software and Technology (UIST, Bend, OR, Oct 29 - Nov 2, 2022). Supplemental video available at https://vimeo.com/737703966
References in corpus (5)
- Critical Reflections on Visualization Authoring Systems
- HoloBoard: a Large-format Immersive Teaching Board based on pseudo HoloGraphics
- Chalktalk : A Visualization and Communication Language -- As a Tool in the Domain of Computer Science Education
- Composition and Configuration Patterns in Multiple-View Visualizations
- From Jam Session to Recital: Synchronous Communication and Collaboration Around Data in Organizations
Cited by in corpus (7)
- The Stories We Tell About Data: Media Types for Data-Driven Storytelling
- Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling
- Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues
- Examining the Effects of Immersive and Non-Immersive Presenter Modalities on Engagement and Social Interaction in Co-located Augmented Presentations
- TangibleNet: Synchronous Network Data Storytelling through Tangible Interactions in Augmented Reality
- Ego vs. Exo and Active vs. Passive: Investigating the Individual and Combined Effects of Viewpoint and Navigation on Spatial Immersion and Understanding in Immersive Storytelling
- InSituTale: Enhancing Augmented Data Storytelling with Physical Objects