45 citations · 69 across the 12 of their papers we have counts for
7 papers · 1 filter
A Novel Frame Structure for Cloud-Based Audio-Visual Speech Enhancement in Multimodal Hearing-aids
Abhijeet Bishnu, Ankit Gupta, Mandar Gogate +5
In this paper, we design a first of its kind transceiver (PHY layer) prototype for cloud-based audio-visual (AV) speech enhancement (SE) complying with high data rate and low laten…
Audio-Visual Speech Enhancement and Separation by Utilizing Multi-Modal Self-Supervised Embeddings
I-Chun Chern, Kuo-Hsuan Hung, Yi-Ting Chen +5
AV-HuBERT, a multi-modal self-supervised learning model, has been shown to be effective for categorical problems such as automatic speech recognition and lip-reading. This suggests…
Canonical Cortical Graph Neural Networks and its Application for Speech Enhancement in Audio-Visual Hearing Aids
Leandro A. Passos, João Paulo Papa, Amir Hussain +1
Despite the recent success of machine learning algorithms, most models face drawbacks when considering more complex tasks requiring interaction between different sources, such as m…
A Speech Intelligibility Enhancement Model based on Canonical Correlation and Deep Learning for Hearing-Assistive Technologies
Tassadaq Hussain, Muhammad Diyan, Mandar Gogate +4
Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are generally trained to minimise the distance between clean and enhanced sp…
A Novel Speech Intelligibility Enhancement Model based on CanonicalCorrelation and Deep Learning
Tassadaq Hussain, Muhammad Diyan, Mandar Gogate +4
Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are often trained to minimise the feature distance between noise-free speech…
A Novel Chaos-based Light-weight Image Encryption Scheme for Multi-modal Hearing Aids
Awais Aziz Shah, Ahsan Adeel, Jawad Ahmad +8
Multimodal hearing aids (HAs) aim to deliver more intelligible audio in noisy environments by contextually sensing and processing data in the form of not only audio but also visual…
Multimodal Audio-Visual Information Fusion using Canonical-Correlated Graph Neural Network for Energy-Efficient Speech Enhancement
Leandro Aparecido Passos, João Paulo Papa, Javier Del Ser +2
This paper proposes a novel multimodal self-supervised architecture for energy-efficient audio-visual (AV) speech enhancement that integrates Graph Neural Networks with canonical c…