18 citations · 119 across the 25 of their papers we have counts for
25 papers
SRF-SVB: Style-Consistent Singing Voice Beautifying via Rectified Flow
Wenhui Li, Biao Dong, Liwei Hu +2
Singing voice beautifying (SVB) aims to correct pitch and rhythm of amateur singing while enhancing vocal quality, preserving lyrics and the singer's timbre. Existing methods, howe…
Spot keywords from very noisy and mixed speech
Ying Shi, Dong Wang, Lantian Li +2
Most existing keyword spotting research focuses on conditions with slight or moderate noise. In this paper, we try to tackle a more challenging task: detecting keywords buried unde…
Time-weighted Frequency Domain Audio Representation with GMM Estimator for Anomalous Sound Detection
Jian Guan, Youde Liu, Qiaoxi Zhu +3
Although deep learning is the mainstream method in unsupervised anomalous sound detection, Gaussian Mixture Model (GMM) with statistical audio frequency representation as input can…
Using Auxiliary Tasks In Multimodal Fusion Of Wav2vec 2.0 And BERT For Multimodal Emotion Recognition
Dekai Sun, Yancheng He, Jiqing Han
The lack of data and the difficulty of multimodal fusion have always been challenges for multimodal emotion recognition (MER). In this paper, we propose to use pretrained models as…
Contrastive Regularization for Multimodal Emotion Recognition Using Audio and Text
Fan Qian, Jiqing Han
Speech emotion recognition is a challenge and an important step towards more natural human-computer interaction (HCI). The popular approach is multimodal emotion recognition based…
Exploring Transformer's potential on automatic piano transcription
Longshen Ou, Ziyi Guo, Emmanouil Benetos +2
Most recent research about automatic music transcription (AMT) uses convolutional neural networks and recurrent neural networks to model the mapping from music signals to symbolic…
Can We Trust Deep Speech Prior?
Ying Shi, Haolin Chen, Zhiyuan Tang +3
Recently, speech enhancement (SE) based on deep speech prior has attracted much attention, such as the variational auto-encoder with non-negative matrix factorization (VAE-NMF) arc…
Toward Speech Separation in The Pre-Cocktail Party Problem with TasTas
Ziqiang Shi, Jiqing Han
In this note, we propose to use TasTas \cite{shi2020speech} for the end-to-end approach to monaural speech separation in the pre-cocktail party problem. Our experiments on the publ…
Speech Separation Based on Multi-Stage Elaborated Dual-Path Deep BiLSTM with Auxiliary Identity Loss
Ziqiang Shi, Rujie Liu, Jiqing Han
Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation.…
LaFurca: Iterative Refined Speech Separation Based on Context-Aware Dual-Path Parallel Bi-LSTM
Ziqiang Shi, Rujie Liu, Jiqing Han
Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation,…
Acoustic Scene Classification by Implicitly Identifying Distinct Sound Events
Hongwei Song, Jiqing Han, Shiwen Deng +1
In this paper, we propose a new strategy for acoustic scene classification (ASC) , namely recognizing acoustic scenes through identifying distinct sound events. This differs from e…
A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech Recognition
Jiabin Xue, Jiqing Han, Tieran Zheng +2
Recently, data-driven based Automatic Speech Recognition (ASR) systems have achieved state-of-the-art results. And transfer learning is often used when those existing systems are a…
Hard Sample Mining for the Improved Retraining of Automatic Speech Recognition
Jiabin Xue, Jiqing Han, Tieran Zheng +2
It is an effective way that improves the performance of the existing Automatic Speech Recognition (ASR) systems by retraining with more and more new training data in the target dom…
A Compact and Discriminative Feature Based on Auditory Summary Statistics for Acoustic Scene Classification
Hongwei Song, Jiqing Han, Shiwen Deng
One of the biggest challenges of acoustic scene classification (ASC) is to find proper features to better represent and characterize environmental sounds. Environmental sounds gene…
Acoustic scene classification using multi-layer temporal pooling based on convolutional neural network
Liwen Zhang, Jiqing Han
The performance of an Acoustic Scene Classification (ASC) system is highly depending on the latent temporal dynamics of the audio signal. In this paper, we proposed a multiple laye…
FurcaNet: An end-to-end deep gated convolutional, long short-term memory, deep neural networks for single channel speech separation
Ziqiang Shi, Huibin Lin, Liu Liu +4
Deep gated convolutional networks have been proved to be very effective in single channel speech separation. However current state-of-the-art framework often considers training the…
Is CQT more suitable for monaural speech separation than STFT? an empirical study
Ziqiang Shi, Huibin Lin, Liu Liu +2
Short-time Fourier transform (STFT) is used as the front end of many popular successful monaural speech separation methods, such as deep clustering (DPCL), permutation invariant tr…
FurcaNeXt: End-to-end monaural speech separation with dynamic gated dilated temporal convolutional networks
Liwen Zhang, Ziqiang Shi, Jiqing Han +2
Deep dilated temporal convolutional networks (TCN) have been proved to be very effective in sequence modeling. In this paper we propose several improvements of TCN for end-to-end a…
Investigation of Monaural Front-End Processing for Robust ASR without Retraining or Joint-Training
Zhihao Du, Xueliang Zhang, Jiqing Han
In recent years, monaural speech separation has been formulated as a supervised learning problem, which has been systematically researched and shown the dramatical improvement of s…
Signal periodic decomposition with conjugate subspaces
Shi-Wen Deng, Ji-Qing Han
In this paper, we focus on hidden period identification and the periodic decomposition of signals. Based on recent results on the Ramanujan subspace, we reveal the conjugate symmet…
Ramanujan subspace pursuit for signal periodic decomposition
Shi-Wen Deng, Ji-Qing Han
The period estimation and periodic decomposition of a signal are the long-standing problems in the field of signal processing and biomolecular sequence analysis. To address such pr…
Identifiability of multivariate logistic mixture models
ZiQiang Shi, TieRan Zheng, JiQing Han
Mixture models have been widely used in modeling of continuous observations. For the possibility to estimate the parameters of a mixture model consistently on the basis of observat…
Guarantees of Augmented Trace Norm Models in Tensor Recovery
Ziqiang Shi, Jiqing Han, Tieran Zheng +2
This paper studies the recovery guarantees of the models of minimizing where is a tensor and a…
Online Learning for Classification of Low-rank Representation Features and Its Applications in Audio Segment Classification
Ziqiang Shi, Jiqing Han, Tieran Zheng +1
In this paper, a novel framework based on trace norm minimization for audio segment is proposed. In this framework, both the feature extraction and classification are obtained by s…