Building and Evaluation of a Real Room Impulse Response Dataset

Abstract

This paper presents BUT ReverbDB - a dataset of real room impulse responses (RIR), background noises and re-transmitted speech data. The retransmitted data includes LibriSpeech test-clean, 2000 HUB5 English evaluation and part of 2010 NIST Speaker Recognition Evaluation datasets. We provide a detailed description of RIR collection (hardware, software, post-processing) that can serve as a "cook-book" for similar efforts. We also validate BUT ReverbDB in two sets of automatic speech recognition (ASR) experiments and draw conclusions for augmenting ASR training data with real and artificially generated RIRs. We show that a limited number of real RIRs, carefully selected to match the target environment, provide results comparable to a large number of artificially generated RIRs, and that both sets can be combined to achieve the best ASR results. The dataset is distributed for free under a non-restrictive license and it currently contains data from 8 rooms, which is growing. The distribution package also contains a Kaldi-based recipe for augmenting publicly available AMI close-talk meeting data and test the results on an AMI single distant microphone set, allowing it to reproduce our experiments.

Submitted to Journal of Selected Topics in Signal Processing, November 2018

References in corpus (1)

• Pyroomacoustics: A Python package for audio room simulations and array processing algorithms

Cited by in corpus (25)

• A Survey of Sound Source Localization with Deep Learning Methods
• ConvMixer: Feature Interactive Convolution with Curriculum Learning for Small Footprint and Noisy Far-field Keyword Spotting
• Attack on practical speaker verification system using universal adversarial perturbations
• MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenes
• GWA: A Large High-Quality Acoustic Dataset for Audio Processing
• Low-frequency Compensated Synthetic Impulse Responses for Improved Far-field Speech Recognition
• MYRiAD: A Multi-Array Room Acoustic Database
• Machine Learning in Acoustics: A Review and Open-Source Repository
• Deep Room Impulse Response Completion
• BERP: A Blind Estimator of Room Parameters for Single-Channel Noisy Speech Signals
• Improving Noise Robustness of an End-to-End Neural Model for Automatic Speech Recognition
• Residual acoustic echo suppression based on efficient multi-task convolutional neural network
• Learning Audio-Visual Dereverberation
• Sequential Multi-Frame Neural Beamforming for Speech Separation and Enhancement
• State-Space Estimation of Spatially Dynamic Room Impulse Responses using a Room Acoustic Model-based Prior
• dEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processing
• Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning
• A study on more realistic room simulation for far-field keyword spotting
• Efficient acoustic feature transformation in mismatched environments using a Guided-GAN
• Late reverberation suppression using U-nets
• Scene-aware Far-field Automatic Speech Recognition
• BUT VOiCES 2019 System Description
• Improving Reverberant Speech Separation with Multi-stage Training and Curriculum Learning
• Multi-style Training for South African Call Centre Audio
• Far-Field Automatic Speech Recognition