4 papers · 1 filter
BaLEEN: Biasing with Latent Encoded Entities for Context-Aware ASR
Chihiro Taguchi, Yotaro Kubo, Rujikorn Charakorn
Transcribing domain-specific entities and rare proper nouns remains a major challenge in automatic speech recognition (ASR). In this paper, we propose BaLEEN (Biasing with Latent E…
Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring
Hikaru Asano, Yotaro Kubo, So Kuroki
Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different limitations: grapheme-to-pro…
Symbiotic Architecture for Post-Hoc Audio Extension of Frozen Language Models
Yotaro Kubo, Qi Sun, Yujin Tang
This paper proposes an architecture for equipping large language models (LLMs) with audio-understanding capabilities without fine-tuning their weights. The proposed symbiotic archi…
Learning Natural Conversational Behavior in Tandem Speech-to-Speech Models with Randomized Guidance
Manato Yaguchi, Yotaro Kubo, Hikaru Asano +1
Tandem speech-to-speech architectures couple a responsive speech frontend with an asynchronous text backend. In KAME, a large language model (LLM) serves as the backend, supplying…