End-to-end named entity extraction from speech
arXiv:1805.12045
Abstract
Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process that consists in processing first an automatic speech recognition (ASR) on the audio and then processing a NER on the ASR outputs. Such approach has some disadvantages (error propagation, metric to tune ASR systems sub-optimal in regards to the final task, reduced space search at the ASR output level...) and it is known that more integrated approaches outperform sequential ones, when they can be applied. In this paper, we present a first study of end-to-end approach that directly extracts named entities from speech, though a unique neural architecture. On a such way, a joint optimization is able for both ASR and NER. Experiments are carried on French data easily accessible, composed of data distributed in several evaluation campaign. Experimental results show that this end-to-end approach provides better results (F-measure=0.69 on test data) than a classical pipeline approach to detect named entity categories (F-measure=0.65).
arXiv commentSubmitted to Interspeech 2018
References in corpus (5)
- Natural Language Processing (almost) from Scratch
- Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
- Text Chunking using Transformation-Based Learning
- End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
- First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs
Cited by in corpus (7)
- End-to-End Spoken Language Understanding: Performance analyses of a voice command task in a low resource setting
- Representation based meta-learning for few-shot spoken intent recognition
- Towards Semi-Supervised Semantics Understanding from Speech
- Audio De-identification: A New Entity Recognition Task
- Speech2Slot: An End-to-End Knowledge-based Slot Filling from Speech
- Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining
- Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translation