4 papers
Phonemes vs. Projectors: An Investigation of Speech-Language Interfaces for LLM-based ASR
Ziwei Li, Lukuang Dong, Saierdaer Yusuyin +2
Integrating pretrained speech encoders with large language models (LLMs) is promising for ASR, but performance and data efficiency depend on the speech-language interface. A common…
Advancing LLM-based phoneme-to-grapheme for multilingual speech recognition
Lukuang Dong, Ziwei Li, Saierdaer Yusuyin +2
Phoneme-based ASR factorizes recognition into speech-to-phoneme (S2P) and phoneme-to-grapheme (P2G), enabling cross-lingual acoustic sharing while keeping language-specific orthogr…
Joint-stochastic-approximation Random Fields with Application to Semi-supervised Learning
Yunfu Song, Zhijian Ou
Our examination of deep generative models (DGMs) developed for semi-supervised learning (SSL), mainly GANs and VAEs, reveals two problems. First, mode missing and mode covering phe…
Joint-stochastic-approximation Autoencoders with Application to Semi-supervised Learning
Wenbo He, Zhijian Ou
Our examination of existing deep generative models (DGMs), including VAEs and GANs, reveals two problems. First, their capability in handling discrete observations and latent codes…