17 citations · 44 across the 15 of their papers we have counts for
15 papers
Quantifying the perceptual value of lexical and non-lexical channels in speech
Sarenne Wallbridge, Peter Bell, Catherine Lai
Speech is a fundamental means of communication that can be seen to provide two channels for transmitting information: the lexical channel of which words are said, and the non-lexic…
Transfer Learning for Personality Perception via Speech Emotion Recognition
Yuanchao Li, Peter Bell, Catherine Lai
Holistic perception of affective attributes is an important human perceptual ability. However, this ability is far from being realized in current affective computing, as not all of…
ASR and Emotional Speech: A Word-Level Investigation of the Mutual Impact of Speech and Emotion Recognition
Yuanchao Li, Zeyu Zhao, Ondrej Klejch +2
In Speech Emotion Recognition (SER), textual data is often used alongside audio signals to address their inherent variability. However, the reliance on human annotated text in most…
Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect Recognition
Yaoting Wang, Yuanchao Li, Paul Pu Liang +3
Fusing multiple modalities has proven effective for multimodal information processing. However, the incongruity between modalities poses a challenge for multimodal fusion, especial…
I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue
Yuanchao Li, Koji Inoue, Leimin Tian +5
Current Spoken Dialogue Systems (SDSs) often serve as passive listeners that respond only after receiving user speech. To achieve human-like dialogue, we propose a novel future pre…
Multimodal Dyadic Impression Recognition via Listener Adaptive Cross-Domain Fusion
Yuanchao Li, Peter Bell, Catherine Lai
As a sub-branch of affective computing, impression recognition, e.g., perception of speaker characteristics such as warmth or competence, is potentially a critical part of both hum…
Exploration of A Self-Supervised Speech Model: A Study on Emotional Corpora
Yuanchao Li, Yumnah Mohamied, Peter Bell +1
Self-supervised speech models have grown fast during the past few years and have proven feasible for use in various downstream tasks. Some recent work has started to look at the ch…
Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE
Shuvayanti Das, Jennifer Williams, Catherine Lai
This paper presents an analysis of speech synthesis quality achieved by simultaneously performing voice conversion and language code-switching using multilingual VQ-VAE speech synt…
A Cross-Domain Approach for Continuous Impression Recognition from Dyadic Audio-Visual-Physio Signals
Yuanchao Li, Catherine Lai
The impression we make on others depends not only on what we say, but also, to a large extent, on how we say it. As a sub-branch of affective computing and social signal processing…
Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics
Yuanchao Li, Catherine Lai
In recent years, many works have investigated the feasibility of conversational robots for performing specific tasks, such as healthcare and interview. Along with this development…
Fusing ASR Outputs in Joint Training for Speech Emotion Recognition
Yuanchao Li, Peter Bell, Catherine Lai
Alongside acoustic information, linguistic features based on speech transcripts have been proven useful in Speech Emotion Recognition (SER). However, due to the scarcity of emotion…
Location, Location: Enhancing the Evaluation of Text-to-Speech Synthesis Using the Rapid Prosody Transcription Paradigm
Elijah Gutierrez, Pilar Oplustil-Gallegos, Catherine Lai
Text-to-Speech synthesis systems are generally evaluated using Mean Opinion Score (MOS) tests, where listeners score samples of synthetic speech on a Likert scale. A major drawback…
It's not what you said, it's how you said it: discriminative perception of speech as a multichannel communication system
Sarenne Wallbridge, Peter Bell, Catherine Lai
People convey information extremely effectively through spoken interaction using multiple channels of information transmission: the lexical channel of what is said, and the non-lex…
Perception of prosodic variation for speech synthesis using an unsupervised discrete representation of F0
Zack Hodari, Catherine Lai, Simon King
In English, prosody adds a broad range of information to segment sequences, from information structure (e.g. contrast) to stylistic variation (e.g. expression of emotion). However,…
Polarity and Intensity: the Two Aspects of Sentiment Analysis
Leimin Tian, Catherine Lai, Johanna D. Moore
Current multimodal sentiment analysis frames sentiment score prediction as a general Machine Learning task. However, what the sentiment score actually represents has often been ove…