SoundShift: Exploring Sound Manipulations for Accessible Mixed-Reality Awareness
arXiv:2401.11095 · doi:10.1145/3643834.3661556
Abstract
Mixed-reality (MR) soundscapes blend real-world sound with virtual audio from hearing devices, presenting intricate auditory information that is hard to discern and differentiate. This is particularly challenging for blind or visually impaired individuals, who rely on sounds and descriptions in their everyday lives. To understand how complex audio information is consumed, we analyzed online forum posts within the blind community, identifying prevailing challenges, needs, and desired solutions. We synthesized the results and propose SoundShift for increasing MR sound awareness, which includes six sound manipulations: Transparency Shift, Envelope Shift, Position Shift, Style Shift, Time Shift, and Sound Append. To evaluate the effectiveness of SoundShift, we conducted a user study with 18 blind participants across three simulated MR scenarios, where participants identified specific sounds within intricate soundscapes. We found that SoundShift increased MR sound awareness and minimized cognitive load. Finally, we developed three real-world example applications to demonstrate the practicality of SoundShift.
DIS 2024
References in corpus (8)
- VRBubble: Enhancing Peripheral Awareness of Avatars for People with Visual Impairments in Social Virtual Reality
- Making Mobile Augmented Reality Applications Accessible
- NavStick: Making Video Games Blind-Accessible via the Ability to Look Around
- ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users
- ClearBuds: Wireless Binaural Earbuds for Learning-Based Speech Enhancement
- Semantic Hearing: Programming Acoustic Scenes with Binaural Hearables
- Uncovering Visually Impaired Gamers' Preferences for Spatial Awareness Tools Within Video Games
- Materialising contexts: virtual soundscapes for real-world exploration