CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaboration

Abstract

Despite the advances and ubiquity of digital communication media such as videoconferencing and virtual reality, they remain oblivious to the rich intentions expressed by users. Beyond transmitting audio, videos, and messages, we envision digital communication media as proactive facilitators that can provide unobtrusive assistance to enhance communication and collaboration. Informed by the results of a formative study, we propose three key design concepts to explore the systematic integration of intelligence into communication and collaboration, including the panel substrate, language-based intent recognition, and lightweight interaction techniques. We developed CrossTalk, a videoconferencing system that instantiates these concepts, which was found to enable a more fluid and flexible communication and collaboration experience.

References in corpus (2)

• Meeting Effectiveness and Inclusiveness in Remote Collaboration
• MeetCues: Supporting Online Meetings Experience

Cited by in corpus (5)

• Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook Diagrams
• Are We On Track? AI-Assisted Active and Passive Goal Reflection During Meetings
• The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video Meetings
• DrawTalking: Building Interactive Worlds by Sketching and Speaking
• Dynamite: Real-Time Debriefing Slide Authoring through AI-Enhanced Multimodal Interaction