Recurrent Neural Networks with Pre-trained Language Model Embedding for Slot Filling Task

Liang Qiu, Yuanyi Ding, Lei He

In recent years, Recurrent Neural Networks (RNNs) based models have been applied to the Slot Filling problem of Spoken Language Understanding and achieved the state-of-the-art perf…