The role of audio-visual integration in the time course of phonetic encoding in self-supervised speech models

Yi Wang, Oli Danyi Liu, Peter Bell

Human speech perception is multimodal. In natural speech, lip movements can precede corresponding voicing by a non-negligible gap of 100-300 ms, especially for specific consonants,…