Do We Need Online NLU Tools?
arXiv:2011.09825 · doi:10.1007/s10579-021-09563-3
Abstract
The intent recognition is an essential algorithm of any conversational AI application. It is responsible for the classification of an input message into meaningful classes. In many bot development platforms, we can configure the NLU pipeline. Several intent recognition services are currently available as an API, or we choose from many open-source alternatives. However, there is no comparison of intent recognition services and open-source algorithms. Many factors make the selection of the right approach to the intent recognition challenging in practice. In this paper, we suggest criteria to choose the best intent recognition algorithm for an application. We present a dataset for evaluation. Finally, we compare selected public NLU services with selected open-source algorithms for intent recognition.
arXiv comment8 pages, 9 tables
References in corpus (17)
- Scikit-learn: Machine Learning in Python
- Distributed Representations of Words and Phrases and their Compositionality
- Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
- Deep Text Classification Can be Fooled
- Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces
- Conversational AI: The Science Behind the Alexa Prize
- DIET: Lightweight Language Understanding for Dialogue Systems
- Benchmarking Natural Language Understanding Services for building Conversational Agents
- Adv-BERT: BERT is not robust on misspellings! Generating nature adversarial samples on BERT
- FastBERT: a Self-distilling BERT with Adaptive Inference Time
- Macro F1 and Macro F1
- Subword Semantic Hashing for Intent Classification on Small Datasets
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
- Alquist: The Alexa Prize Socialbot
- Learning from Past Mistakes: Improving Automatic Speech Recognition Output via Noisy-Clean Phrase Context Modeling
- Alquist 2.0: Alexa Prize Socialbot Based on Sub-Dialogue Models
- Alquist 3.0: Alexa Prize Bot Using Conversational Knowledge Graph