Multi-Microphone Noise Data Augmentation for DNN-based Own Voice Reconstruction for Hearables in Noisy Environments
arXiv:2312.08908 · doi:10.1109/ICASSP48485.2024.10447066
Abstract
Hearables with integrated microphones may offer communication benefits in noisy working environments, e.g. by transmitting the recorded own voice of the user. Systems aiming at reconstructing the clean and full-bandwidth own voice from noisy microphone recordings are often based on supervised learning. Recording a sufficient amount of noise required for training such a system is costly since noise transmission between outer and inner microphones varies individually. Previously proposed methods either do not consider noise, only consider noise at outer microphones or assume inner and outer microphone noise to be independent during training, and it is not yet clear whether individualized noise can benefit the training of and own voice reconstruction system. In this paper, we investigate several noise data augmentation techniques based on measured transfer functions to simulate multi-microphone noise. Using augmented noise, we train a multi-channel own voice reconstruction system. Experiments using real noise are carried out to investigate the generalization capability. Results show that incorporating augmented noise yields large benefits, in particular considering individualized noise augmentation leads to higher performance.
arXiv commentICASSP 2024 (c) 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
References in corpus (6)
- Insights Into Deep Non-linear Filters for Improved Multi-channel Speech Enhancement
- Time-Domain Multi-modal Bone/air Conducted Speech Enhancement
- EBEN: Extreme bandwidth extension network applied to speech signals captured with noise-resilient body-conduction microphones
- Deep Multi-Frame MVDR Filtering for Binaural Noise Reduction
- Training Strategies for Own Voice Reconstruction in Hearing Protection Devices using an In-ear Microphone
- Dictionary-Based Fusion of Contact and Acoustic Microphones for Wind Noise Reduction