DNN-based Source Enhancement to Increase Objective Sound Quality Assessment Score
arXiv:1810.09137 · doi:10.1109/TASLP.2018.2842156
Abstract
We propose a training method for deep neural network (DNN)-based source enhancement to increase objective sound quality assessment (OSQA) scores such as the perceptual evaluation of speech quality (PESQ). In many conventional studies, DNNs have been used as a mapping function to estimate time-frequency masks and trained to minimize an analytically tractable objective function such as the mean squared error (MSE). Since OSQA scores have been used widely for sound-quality evaluation, constructing DNNs to increase OSQA scores would be better than using the minimum-MSE to create high-quality output signals. However, since most OSQA scores are not analytically tractable, \textit{i.e.}, they are black boxes, the gradient of the objective function cannot be calculated by simply applying back-propagation. To calculate the gradient of the OSQA-based objective function, we formulated a DNN optimization scheme on the basis of \textit{black-box optimization}, which is used for training a computer that plays a game. For a black-box-optimization scheme, we adopt the policy gradient method for calculating the gradient on the basis of a sampling algorithm. To simulate output signals using the sampling algorithm, DNNs are used to estimate the probability density function of the output signals that maximize OSQA scores. The OSQA scores are calculated from the simulated output signals, and the DNNs are trained to increase the probability of generating the simulated output signals that achieve high OSQA scores. Through several experiments, we found that OSQA scores significantly increased by applying the proposed method, even though the MSE was not minimized.
References in corpus (1)
Cited by in corpus (17)
- Learning with Learned Loss Function: Speech Enhancement with Quality-Net to Improve Perceptual Evaluation of Speech Quality
- MetricGAN+: An Improved Version of MetricGAN for Speech Enhancement
- Improving the Robustness and Clinical Applicability of Automatic Respiratory Sound Classification Using Deep Learning-Based Audio Enhancement: Algorithm Development and Validation
- Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement
- Controlling the Remixing of Separated Dialogue with a Non-Intrusive Quality Estimate
- Components Loss for Neural Networks in Mask-Based Speech Enhancement
- Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminability
- Multichannel Speech Enhancement by Raw Waveform-mapping using Fully Convolutional Networks
- Controlling the Perceived Sound Quality for Dialogue Enhancement with Deep Learning
- Data-driven design of perfect reconstruction filterbank for DNN-based sound source enhancement
- WhisperMask: A Noise Suppressive Mask-Type Microphone for Whisper Speech
- AdaFlow: Domain-Adaptive Density Estimator with Application to Anomaly Detection and Unpaired Cross-Domain Translation
- Masks Fusion with Multi-Target Learning For Speech Enhancement
- SNRi Target Training for Joint Speech Enhancement and Recognition
- Learning to Model Aspects of Hearing Perception Using Neural Loss Functions
- Invertible DNN-based nonlinear time-frequency transform for speech enhancement
- Reinforcement Learning Based Speech Enhancement for Robust Speech Recognition