activity
20222025
most citedAdaptive Knowledge Distillation between Text and Speech Pre-trained Models

1 citations · 2 across the 12 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.SD2023

Are Soft Prompts Good Zero-shot Learners for Speech Recognition?

Dianwen Ng, Chong Zhang, Ruixi Zhang +7

Large self-supervised pre-trained speech models require computationally expensive fine-tuning for downstream tasks. Soft prompt tuning offers a simple parameter-efficient alternati…

eess.AS2023

SPGM: Prioritizing Local Features for enhanced speech separation performance

Jia Qi Yip, Shengkui Zhao, Yukun Ma +8

Dual-path is a popular architecture for speech separation models (e.g. Sepformer) which splits long sequences into overlapping chunks for its intra- and inter-blocks that separatel…

cs.SD2023★ 1 cited

Contrastive Speech Mixup for Low-resource Keyword Spotting

Dianwen Ng, Ruixi Zhang, Jia Qi Yip +6

Most of the existing neural-based models for keyword spotting (KWS) in smart devices require thousands of training samples to learn a decent audio representation. However, with the…

cs.CL2023★ 1 cited

Adaptive Knowledge Distillation between Text and Speech Pre-trained Models

Jinjie Ni, Yukun Ma, Wen Wang +7

Learning on a massive amount of speech corpus leads to the recent success of many self-supervised speech models. With knowledge distillation, these models may also benefit from the…

cs.SD2023

deHuBERT: Disentangling Noise in a Self-supervised Model for Robust Speech Recognition

Dianwen Ng, Ruixi Zhang, Jia Qi Yip +7

Existing self-supervised pre-trained speech models have offered an effective way to leverage massive unannotated corpora to build good automatic speech recognition (ASR). However,…