output
20122026
most citedLarge-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

639 citations

Showing cs.SDShow all

8 papers · 1 filter

cs.SD2026

Audio-to-Score Transcription using Pre-trained Features, Data Augmentation, and the New SheetSage-A2S Dataset

Eoin Cummins, Zhongyi Huang, Alexandre D'Hooge +2

Existing audio-to-score (A2S) systems primarily focus on classical music, and the application to popular music remains underexplored. This paper first presents the new SheetSage-A2…

cs.SD2025

Frame-level Temporal Difference Learning for Partial Deepfake Speech Detection

Menglu Li, Xiao-Ping Zhang, Lian Zhao

Detecting partial deepfake speech is essential due to its potential for subtle misinformation. However, existing methods depend on costly frame-level annotations during training, l…

cs.SD2024★ 10 cited

VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling

Yixuan Zhou, Xiaoyu Qin, Zeyu Jin +5

Recent AIGC systems possess the capability to generate digital multimedia content based on human language instructions, such as text, image and video. However, when it comes to spe…

cs.SD2024★ 56 cited

A Survey on Speech Deepfake Detection

Menglu Li, Yasaman Ahmadiadli, Xiao-Ping Zhang

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophistica…

cs.SD2024★ 7 cited

Exploring Multi-Modal Control in Music-Driven Dance Generation

Ronghui Li, Yuqin Dai, Yachao Zhang +4

Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these i…

cs.SD2023

Text-Only Domain Adaptation for End-to-End Speech Recognition through Down-Sampling Acoustic Representation

Jiaxu Zhu, Weinan Tong, Yaoxun Xu +6

Mapping two modalities, speech and text, into a shared representation space, is a research topic of using text-only data to improve end-to-end automatic speech recognition (ASR) pe…

cs.SD2023

Improving Mandarin Prosodic Structure Prediction with Multi-level Contextual Information

Jie Chen, Changhe Song, Deyi Tuo +4

For text-to-speech (TTS) synthesis, prosodic structure prediction (PSP) plays an important role in producing natural and intelligible speech. Although inter-utterance linguistic in…

cs.SD2023★ 12 cited

LightGrad: Lightweight Diffusion Probabilistic Model for Text-to-Speech

Jie Chen, Xingchen Song, Zhendong Peng +3

Recent advances in neural text-to-speech (TTS) models bring thousands of TTS applications into daily life, where models are deployed in cloud to provide services for customs. Among…