Neural Information Retrieval: A Literature Review
arXiv:1611.06792
Abstract
A recent "third wave" of Neural Network (NN) approaches now delivers state-of-the-art performance in many machine learning tasks, spanning speech recognition, computer vision, and natural language processing. Because these modern NNs often comprise multiple interconnected layers, this new NN research is often referred to as deep learning. Stemming from this tide of NN work, a number of researchers have recently begun to investigate NN approaches to Information Retrieval (IR). While deep NNs have yet to achieve the same level of success in IR as seen in other areas, the recent surge of interest and work in NNs for IR suggest that this state of affairs may be quickly changing. In this work, we survey the current landscape of Neural IR research, paying special attention to the use of learned representations of queries and documents (i.e., neural embeddings). We highlight the successes of neural IR thus far, catalog obstacles to its wider adoption, and suggest potentially promising directions for future research.
44 pages
References in corpus (20)
- Deep Learning in Neural Networks: An Overview
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Natural Language Processing (almost) from Scratch
- Convolutional Neural Networks for Sentence Classification
- Convolutional Neural Network Architectures for Matching Natural Language Sentences
- A Deep Relevance Matching Model for Ad-hoc Retrieval
- Deep Learning for Answer Sentence Selection
- Question Answering with Subgraph Embeddings
- Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews
- Using Word Embeddings for Automatic Query Expansion
- Query Expansion with Locally-Trained Word Embeddings
- Modelling User Preferences using Word Embeddings for Context-Aware Venue Recommendation
- Adaptability of Neural Networks on Varying Granularity IR Tasks
- Representing Documents and Queries as Sets of Word Embedded Vectors for Information Retrieval
- Deep Feature Fusion Network for Answer Quality Prediction in Community Question Answering
- Deep Learning Relevance: Creating Relevant Information (as Opposed to Retrieving it)
- Learning Dynamic Classes of Events using Stacked Multilayer Perceptron Networks
- Toward Word Embedding for Personalized Information Retrieval
- Selective Term Proximity Scoring Via BP-ANN