Data-driven models and computational tools for neurolinguistics: a language technology perspective
arXiv:2003.10540
Abstract
In this paper, our focus is the connection and influence of language technologies on the research in neurolinguistics. We present a review of brain imaging-based neurolinguistic studies with a focus on the natural language representations, such as word embeddings and pre-trained language models. Mutual enrichment of neurolinguistics and language technologies leads to development of brain-aware natural language representations. The importance of this research area is emphasized by medical applications.
arXiv comment37 pages, 1 figure
References in corpus (10)
- Distributed Representations of Words and Phrases and their Compositionality
- Natural Language Processing (almost) from Scratch
- Distributed Representations of Sentences and Documents
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- Skip-Thought Vectors
- Assessing BERT's Syntactic Abilities
- Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)
- Breaking Sticks and Ambiguities with Adaptive Skip-gram
- Training and Evaluating Multimodal Word Embeddings with Large-scale Web Annotated Images
- Understanding language-elicited EEG data by predicting it from a fine-tuned language model