activity
20242026
most citedvideo-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Model

2 citations · 6 across the 18 of their papers we have counts for

collaborators
Showing 2024Show all

6 papers · 1 filter

eess.AS2024

An End-To-End Stuttering Detection Method Based On Conformer And BILSTM

Xiaokang Liu, Changqing Xu, Yudong Yang +2

Stuttering is a neurodevelopmental speech disorder characterized by common speech symptoms such as pauses, exclamations, repetition, and prolongation. Speech-language pathologists…

cs.CV2024★ 1 cited

Enhancing Multimodal LLM for Detailed and Accurate Video Captioning using Multi-Round Preference Optimization

Changli Tang, Yixuan Li, Yudong Yang +5

Videos contain a wealth of information, and generating detailed and accurate descriptions in natural language is a key aspect of video understanding. In this paper, we present vide…

eess.AS2024★ 1 cited

Enabling Auditory Large Language Models for Automatic Speech Quality Evaluation

Siyin Wang, Wenyi Yu, Yudong Yang +10

Speech quality assessment typically requires evaluating audio from multiple aspects, such as mean opinion score (MOS) and speaker similarity (SIM) \etc., which can be challenging t…

eess.AS2024

Extract and Diffuse: Latent Integration for Improved Diffusion-based Speech and Vocal Enhancement

Yudong Yang, Zhan Liu, Wenyi Yu +3

Diffusion-based generative models have recently achieved remarkable results in speech and vocal enhancement due to their ability to model complex speech data distributions. While t…

eess.AS2024

Automatic Assessment of Dysarthria Using Audio-visual Vowel Graph Attention Network

Xiaokang Liu, Xiaoxia Du, Juan Liu +7

Automatic assessment of dysarthria remains a highly challenging task due to high variability in acoustic signals and the limited data. Currently, research on the automatic assessme…

cs.SD2024★ 1 cited

An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Data

Yudong Yang, Rongfeng Su, Xiaokang Liu +2

Acoustic-to-articulatory inversion (AAI) is to convert audio into articulator movements, such as ultrasound tongue imaging (UTI) data. An issue of existing AAI methods is only usin…