Efficient Dynamic WFST Decoding for Personalized Language Models

Jun Liu, Jiedan Zhu, Vishal Kathuria +1

We propose a two-layer cache mechanism to speed up dynamic WFST decoding with personalized language models. The first layer is a public cache that stores most of the static part of…