15 citations · 18 across the 17 of their papers we have counts for
16 papers · 1 filter
GAN-based Joint Dereverberation and Directional Filtering
Weilong Huang, Shrishti Saha Shetu, Emanuël A. P. Habets
Recently, neural directional filtering (NDF) enables reconstruction of a virtual directional microphone (VDM) with a desired directivity pattern, accurately rendering multi-source…
SlimDiffuSE: Towards Efficient Diffusion-Based Speech Enhancement using Slimmable Networks
Nagashree K. S. Rao, Shrishti Saha Shetu, Mohamed Elminshawi +2
Diffusion-based models are emerging in the speech enhancement domain and are achieving state-of-the-art performance across various benchmark datasets. A major downside of diffusion…
μNet: Ultra-Low-Memory and Low-Complexity Speech Enhancement for Embedded Digital Signal Processors
Shrishti Saha Shetu, Jose Miguel Martinez Aponte, Nagashree K. S. Rao +3
Speech enhancement on embedded digital signal processors (DSPs) imposes strict constraints on memory footprint, computational complexity, latency, and support for integer operation…
Revisiting Vocos: That Phasiness Business in Time-Frequency Neural Vocoding
Ünal Ege Gaznepoğlu, Frank Zalkow, Mohammad Joshaghani +3
Recently, time-frequency neural vocoders have been approaching the state-of-the-art quality of time-domain neural vocoders. Vocos is a notable example due to its efficiency, but it…
Beyond Cross-Reconstruction: Probing-Based Disentanglement Evaluation for Acoustic Teleportation Codecs
Philipp Grundhuber, Emanuël A. P. Habets
Some neural audio codecs disentangle speech into latent subspaces encoding content, speaker identity, and acoustics, enabling acoustic teleportation and voice conversion. Existing…
NDF+: Joint Neural Directional Filtering and Diffuse Sound Extraction
Weilong Huang, Le Nhat Tam Huynh, Oliver Thiergart +1
Recently, neural directional filtering (NDF) has been introduced as a flexible approach for reconstructing a virtual directional microphone (VDM) with a desired directivity pattern…
Robust Speech Activity Detection in the Presence of Singing Voice
Philipp Grundhuber, Mhd Modar Halimeh, Martin Strauß +1
Speech Activity Detection (SAD) systems often misclassify singing as speech, leading to degraded performance in applications such as dialogue enhancement and automatic speech recog…
Neural Directional Filtering Using a Compact Microphone Array
Weilong Huang, Srikanth Raj Chetupalli, Mhd Modar Halimeh +2
Beamforming with desired directivity patterns using compact microphone arrays is essential in many audio applications. Directivity patterns achievable using traditional beamformers…
Acoustic Teleportation via Disentangled Neural Audio Codec Representations
Philipp Grundhuber, Mhd Modar Halimeh, Emanuël A. P. Habets
This paper presents an approach for acoustic teleportation by disentangling speech content from acoustic environment characteristics in neural audio codec representations. Acoustic…
Leveraging Discriminative Latent Representations for Conditioning GAN-Based Speech Enhancement
Shrishti Saha Shetu, Emanuël A. P. Habets, Andreas Brendel
Generative speech enhancement methods based on generative adversarial networks (GANs) and diffusion models have shown promising results in various speech enhancement tasks. However…
Navigating PESQ: Up-to-Date Versions and Open Implementations
Matteo Torcoli, Mhd Modar Halimeh, Emanuël A. P. Habets
Perceptual Evaluation of Speech Quality (PESQ) is an objective quality measure that remains widely used despite its withdrawal by the International Telecommunication Union (ITU). P…
Expanding and Analyzing ODAQ -- the Open Dataset of Audio Quality
Sascha Dick, Christoph Thompson, Chih-Wei Wu +4
The Open Dataset of Audio Quality (ODAQ) was recently introduced to address the scarcity of openly available audio datasets with corresponding subjective quality scores. The datase…
Speaker Verification in Multi-Speaker Environments Using Temporal Feature Fusion
Ahmad Aloradi, Wolfgang Mack, Mohamed Elminshawi +1
Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verif…
New Insights on Target Speaker Extraction
Mohamed Elminshawi, Wolfgang Mack, Srikanth Raj Chetupalli +2
Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary i…
Efficient Training Data Generation for Phase-Based DOA Estimation
Fabian Hübner, Wolfgang Mack, Emanuël A. P. Habets
Deep learning (DL) based direction of arrival (DOA) estimation is an active research topic and currently represents the state-of-the-art. Usually, DL-based DOA estimators are train…
An Empirical Study of Visual Features for DNN based Audio-Visual Speech Enhancement in Multi-talker Environments
Shrishti Saha Shetu, Soumitro Chakrabarty, Emanuël A. P. Habets
Audio-visual speech enhancement (AVSE) methods use both audio and visual features for the task of speech enhancement and the use of visual features has been shown to be particularl…