281 citations · 1.6k across the 109 of their papers we have counts for
20 papers · 1 filter
On Unsupervised Uncertainty-Driven Speech Pseudo-Label Filtering and Model Calibration
Nauman Dawalatabad, Sameer Khurana, Antoine Laurent +1
Pseudo-label (PL) filtering forms a crucial part of Self-Training (ST) methods for unsupervised domain adaptation. Dropout-based Uncertainty-driven Self-Training (DUST) proceeds by…
Similarity Analysis of Self-Supervised Speech Representations
Yu-An Chung, Yonatan Belinkov, James Glass
Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scal…
CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
Sameer Khurana, Antoine Laurent, James Glass
More than half of the 7,000 languages in the world are in imminent danger of going extinct. Traditional methods of documenting language proceed by collecting audio data followed by…
A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning
Sameer Khurana, Antoine Laurent, Wei-Ning Hsu +4
Probabilistic Latent Variable Models (LVMs) provide an alternative to self-supervised learning approaches for linguistic representation learning from speech. LVMs admit an intuitiv…
Vector-Quantized Autoregressive Predictive Coding
Yu-An Chung, Hao Tang, James Glass
Autoregressive Predictive Coding (APC), as a self-supervised objective, has enjoyed success in learning representations from large amounts of unlabeled data, and the learned repres…
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Yu-An Chung, James Glass
Training objectives based on predictive coding have recently been shown to be very effective at learning meaningful representations from unlabeled speech. One example is Autoregres…
Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT
Francois Grondin, Hao Tang, James Glass
This paper proposes a straightforward 2-D method to spatially calibrate the visual field of a camera with the auditory field of an array microphone by generating and overlaying an…
Sound Event Localization and Detection Using CRNN on Pairs of Microphones
Francois Grondin, James Glass, Iwona Sobieraj +1
This paper proposes sound event localization and detection methods from multichannel recording. The proposed system is based on two Convolutional Recurrent Neural Networks (CRNNs)…
Generative Pre-Training for Speech with Autoregressive Predictive Coding
Yu-An Chung, James Glass
Learning meaningful and general representations from unannotated speech that are applicable to a wide range of tasks remains challenging. In this paper we propose to use autoregres…
Fast and Robust 3-D Sound Source Localization with DSVD-PHAT
Francois Grondin, James Glass
This paper introduces a variant of the Singular Value Decomposition with Phase Transform (SVD-PHAT), named Difference SVD-PHAT (DSVD-PHAT), to achieve robust Sound Source Localizat…
Multiple Sound Source Localization with SVD-PHAT
Francois Grondin, James Glass
This paper introduces a modification of phase transform on singular value decomposition (SVD-PHAT) to localize multiple sound sources. This work aims to improve localization accura…
MCE 2018: The 1st Multi-target Speaker Detection and Identification Challenge Evaluation
Suwon Shon, Najim Dehak, Douglas Reynolds +1
The Multi-target Challenge aims to assess how well current speech technology is able to determine whether or not a recorded utterance was spoken by one of a large number of blackli…
VoiceID Loss: Speech Enhancement for Speaker Verification
Suwon Shon, Hao Tang, James Glass
In this paper, we propose VoiceID loss, a novel loss function for training a speech enhancement model to improve the robustness of speaker verification. In contrast to the commonly…
Domain Attentive Fusion for End-to-end Dialect Identification with Unknown Target Domain
Suwon Shon, Ahmed Ali, James Glass
End-to-end deep learning language or dialect identification systems operate on the spectrogram or other acoustic feature and directly generate identification scores for each class.…
A Study of the Complexity and Accuracy of Direction of Arrival Estimation Methods Based on GCC-PHAT for a Pair of Close Microphones
Francois Grondin, James Glass
This paper investigates the accuracy of various Generalized Cross-Correlation with Phase Transform (GCC-PHAT) methods for a close pair of microphones. We investigate interpolation-…
On The Inductive Bias of Words in Acoustics-to-Word Models
Hao Tang, James Glass
Acoustics-to-word models are end-to-end speech recognizers that use words as targets without relying on pronunciation dictionaries or graphemes. These models are notoriously diffic…
SVD-PHAT: A Fast Sound Source Localization Method
Francois Grondin, James Glass
This paper introduces a new localization method called SVD-PHAT. The SVD-PHAT method relies on Singular Value Decomposition of the SRP-PHAT projection matrix. A k-d tree is also pr…
Unsupervised Representation Learning of Speech for Dialect Identification
Suwon Shon, Wei-Ning Hsu, James Glass
In this paper, we explore the use of a factorized hierarchical variational autoencoder (FHVAE) model to learn an unsupervised latent representation for dialect identification (DID)…
Frame-level speaker embeddings for text-independent speaker recognition and analysis of end-to-end model
Suwon Shon, Hao Tang, James Glass
In this paper, we propose a Convolutional Neural Network (CNN) based speaker recognition model for extracting robust speaker embeddings. The embedding can be extracted efficiently…
MCE 2018: The 1st Multi-target Speaker Detection and Identification Challenge Evaluation (MCE) Plan, Dataset and Baseline System
Suwon Shon, Najim Dehak, Douglas Reynolds +1
The Multitarget Challenge aims to assess how well current speech technology is able to determine whether or not a recorded utterance was spoken by one of a large number of 'blackli…