activity
20202023
most citedWhat Makes Multi-modal Learning Better than Single (Provably)

43 citations · 150 across the 24 of their papers we have counts for

collaborators
Showing cs.SDShow all

5 papers · 1 filter

cs.SD2023★ 7 cited

Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

Simian Luo, Chuanhao Yan, Chenxu Hu +1

The Video-to-Audio (V2A) model has recently gained attention for its practical application in generating audio directly from silent videos, particularly in video/film production. H…

cs.SD2022★ 5 cited

Controllable and Lossless Non-Autoregressive End-to-End Text-to-Speech

Zhengxi Liu, Qiao Tian, Chenxu Hu +5

Some recent studies have demonstrated the feasibility of single-stage neural text-to-speech, which does not need to generate mel-spectrograms but generates the raw waveforms direct…

cs.SD2022

Radio2Speech: High Quality Speech Recovery from Radio Frequency Signals

Running Zhao, Jiangtao Yu, Tingle Li +2

Considering the microphone is easily affected by noise and soundproof materials, the radio frequency (RF) signal is a promising candidate to recover audio as it is immune to noise…

cs.SD2022★ 8 cited

Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation

Zui Chen, Yansen Jing, Shengcheng Yuan +3

Synthesizer is a type of electronic musical instrument that is now widely used in modern music production and sound design. Each parameters configuration of a synthesizer produces…

cs.SD2020★ 3 cited

CVC: Contrastive Learning for Non-parallel Voice Conversion

Tingle Li, Yichen Liu, Chenxu Hu +1

Cycle consistent generative adversarial network (CycleGAN) and variational autoencoder (VAE) based models have gained popularity in non-parallel voice conversion recently. However,…