2 citations · 3 across the 5 of their papers we have counts for
3 papers · 1 filter
Toward a Universal Local Speech Feature Extractor Through Distillation
Jessica Yang, Marcelo Beramendi Caballero, Ju-Chieh Chou +1
Self-supervised speech models commonly consist of a set of convolutional neural network (CNN) layers used as a local feature extractor, followed by transformer layers. The CNN laye…
Distilling Text LMs into Speech-to-Speech LMs by Matching Internal Text Predictions
Ju-Chieh Chou, Jiawei Zhou, Karen Livescu
Text language models (LMs) acquire broad linguistic and factual capabilities through large-scale pretraining, while comparable capabilities remain difficult to learn from speech al…
Quantifying the Generation Modality Gap in Speech-Text Language Models
Ju-Chieh Chou, Jiawei Zhou, Karen Livescu
Pure speech language models often lag behind text and speech-text language models in generating coherent content, but this gap is difficult to quantify because speech and text syst…