5 papers
Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety
Riccardo Bovo, George Loukas, Josh P. Davis
Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance operates only at registration a…
Revisiting put-that-there, context aware window interactions via LLMs
Riccardo Bovo, Daniele Giunchi, Pasquale Cascarano +2
We revisit Bolt's classic "Put-That-There" concept for modern head-mounted displays by pairing Large Language Models (LLMs) with XR sensor and tech stack. The agent fuses (i) a sem…
Augmenting speech transcripts of VR recordings with gaze, pointing, and visual context for multimodal coreference resolution
Riccardo Bovo, Frederik Brudy, George Fitzmaurice +1
Understanding transcripts of immersive multimodal conversations is challenging because speakers frequently rely on visual context and non-verbal cues, such as gestures and visual a…
Symbiotic AI: Augmenting Human Cognition from PCs to Cars
Riccardo Bovo, Karan Ahuja, Ryo Suzuki +2
As AI takes on increasingly complex roles in human-computer interaction, fundamental questions arise: how can HCI help maintain the user as the primary agent while augment human co…
EmBARDiment: an Embodied AI Agent for Productivity in XR
Riccardo Bovo, Steven Abreu, Karan Ahuja +3
XR devices running chat-bots powered by Large Language Models (LLMs) have the to become always-on agents that enable much better productivity scenarios. Current screen based chat-b…