3 papers
cs.CL2025
The time scale of redundancy between prosody and linguistic context
Tamar I. Regev, Chiebuka Ohams, Shaylee Xie +5
In spoken communication, information is transmitted not only via words, but also through a rich array of non-verbal signals, including prosody--the non-segmental auditory features…
cs.CL2023
WhisBERT: Multimodal Text-Audio Language Modeling on 100M Words
Lukas Wolf, Greta Tuckute, Klemen Kotar +4
Training on multiple modalities of input can augment the capabilities of a language model. Here, we ask whether such a training regime can improve the quality and efficiency of the…
cs.CL2023
Quantifying the redundancy between prosody and text
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko +4
Prosody -- the suprasegmental component of speech, including pitch, loudness, and tempo -- carries critical aspects of meaning. However, the relationship between the information co…