Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio--Text Cross-Attention

TingTing Gu, JinCheng Luo, WenQiu Guo

Ambivalence and hesitancy (A/H) are subtle behavioural states that can be expressed through both what a person says and how it is spoken. This paper presents an audio--text framewo…