Supervised and Unsupervised Speech Enhancement Using Nonnegative Matrix Factorization
arXiv:1709.05362 · doi:10.1109/TASL.2013.2270369
Abstract
Reducing the interference noise in a monaural noisy speech signal has been a challenging task for many years. Compared to traditional unsupervised speech enhancement methods, e.g., Wiener filtering, supervised approaches, such as algorithms based on hidden Markov models (HMM), lead to higher-quality enhanced speech signals. However, the main practical difficulty of these approaches is that for each noise type a model is required to be trained a priori. In this paper, we investigate a new class of supervised speech denoising algorithms using nonnegative matrix factorization (NMF). We propose a novel speech enhancement method that is based on a Bayesian formulation of NMF (BNMF). To circumvent the mismatch problem between the training and testing stages, we propose two solutions. First, we use an HMM in combination with BNMF (BNMF-HMM) to derive a minimum mean square error (MMSE) estimator for the speech signal with no information about the underlying noise type. Second, we suggest a scheme to learn the required noise BNMF model online, which is then used to develop an unsupervised speech enhancement system. Extensive experiments are carried out to investigate the performance of the proposed methods under different conditions. Moreover, we compare the performance of the developed algorithms with state-of-the-art speech enhancement schemes using various objective measures. Our simulations show that the proposed BNMF-based methods outperform the competing algorithms substantially.
References in corpus (1)
Cited by in corpus (43)
- Audio-visual Speech Enhancement Using Conditional Variational Auto-Encoders
- Speech enhancement with variational autoencoders and alpha-stable distributions
- ClearBuds: Wireless Binaural Earbuds for Learning-Based Speech Enhancement
- A Variational EM Algorithm for the Separation of Time-Varying Convolutive Audio Mixtures
- Speech Dereverberation Using Nonnegative Convolutive Transfer Function and Spectro temporal Modeling
- Multi-Objective Learning and Mask-Based Post-Processing for Deep Neural Network Based Speech Enhancement
- SkipConvGAN: Monaural Speech Dereverberation using Generative Adversarial Networks via Complex Time-Frequency Masking
- Wavelet speech enhancement based on nonnegative matrix factorization
- On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression
- A State-Space Approach to Dynamic Nonnegative Matrix Factorization
- An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning
- The Cone of Silence: Speech Separation by Localization
- Mixture of Inference Networks for VAE-based Audio-visual Speech Enhancement
- SNR-Based Features and Diverse Training Data for Robust DNN-Based Speech Enhancement
- On the Importance of Super-Gaussian Speech Priors for Machine-Learning Based Speech Enhancement
- Unsupervised Low Latency Speech Enhancement with RT-GCC-NMF
- Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challenge
- Low Rank and Sparsity Analysis Applied to Speech Enhancement via Online Estimated Dictionary
- The CHiME-7 UDASE task: Unsupervised domain adaptation for conversational speech enhancement
- Direction of Arrival with One Microphone, a few LEGOs, and Non-Negative Matrix Factorization
- Deep Speech Enhancement for Reverberated and Noisy Signals using Wide Residual Networks
- Speech Enhancement based on Denoising Autoencoder with Multi-branched Encoders
- Modeling the Comb Filter Effect and Interaural Coherence for Binaural Source Separation
- Music Source Separation with Generative Flow
- Relative Pairwise Relationship Constrained Non-negative Matrix Factorisation
- CITISEN: A Deep Learning-Based Speech Signal-Processing Mobile Application
- Improved Lite Audio-Visual Speech Enhancement
- On Cross-Corpus Generalization of Deep Learning Based Speech Enhancement
- Multichannel Speech Enhancement by Raw Waveform-mapping using Fully Convolutional Networks
- Cracking the cocktail party problem by multi-beam deep attractor network
- Speech enhancement with weakly labelled data from AudioSet
- Speech Enhancement Based on Cyclegan with Noise-informed Training
- A Speech Enhancement Algorithm based on Non-negative Hidden Markov Model and Kullback-Leibler Divergence
- Generative Speech Enhancement Based on Cloned Networks
- End-to-end speech enhancement based on discrete cosine transform
- Normalized Features for Improving the Generalization of DNN Based Speech Enhancement
- Adaptive dictionary based approach for background noise and speaker classification and subsequent source separation
- Improving the Intelligibility of Electric and Acoustic Stimulation Speech Using Fully Convolutional Networks Based Speech Enhancement
- Directional Embedding Based Semi-supervised Framework For Bird Vocalization Segmentation
- Semi-supervised Speech Enhancement in Envelop and Details Subspaces
- PROSE: Perceptual Risk Optimization for Speech Enhancement
- Single Channel Speech Enhancement Using Temporal Convolutional Recurrent Neural Networks
- Deep Speech Denoising with Vector Space Projections