Speech-based Mark for Data Sonification
arXiv:2408.06942 · doi:10.1145/3663548.3688514
Abstract
Sonification serves as a powerful tool for data accessibility, especially for people with vision loss. Among various modalities, speech is a familiar means of communication similar to the role of text in visualization. However, speech-based sonification is underexplored. We introduce SpeechTone, a novel speech-based mark for data sonification and extension to the existing Erie declarative grammar for sonification. It encodes data into speech attributes such as pitch, speed, voice and speech content. We demonstrate the efficacy of SpeechTone through three examples.
Accepted in ASSETS '24, October 27-30, 2024, St. John's, NL, Canada
References in corpus (5)
- SeeChart: Enabling Accessible Visualizations Through Interactive Natural Language Interface For People with Visual Impairments
- A Dataset of Alt Texts from HCI Publications: Analyses and Uses Towards Producing More Descriptive Alt Texts of Data Visualizations in Scientific Papers
- TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
- Erie: A Declarative Grammar for Data Sonification
- Interactive Sonification for Health and Energy using ChucK and Unity