Cached LLM Probability Retrieval for Speech Recognition

Sheng Li, Takahiro Shinozaki, Tatsuya Kawahara

Large language models (LLMs) enhance automatic speech recognition (ASR) by providing linguistic priors; however, their direct rescoring is costly because it requires evaluating eve…