Using Word Embeddings for Automatic Query Expansion

Abstract

In this paper a framework for Automatic Query Expansion (AQE) is proposed using distributed neural language model word2vec. Using semantic and contextual relation in a distributed and unsupervised framework, word2vec learns a low dimensional embedding for each vocabulary entry. Using such a framework, we devise a query expansion technique, where related terms to a query are obtained by K-nearest neighbor approach. We explore the performance of the AQE methods, with and without feedback query expansion, and a variant of simple K-nearest neighbor in the proposed framework. Experiments on standard TREC ad-hoc data (Disk 4, 5 with query sets 301-450, 601-700) and web data (WT10G data with query set 451-550) shows significant improvement over standard term-overlapping based retrieval methods. However the proposed method fails to achieve comparable performance with statistical co-occurrence based feedback method such as RM3. We have also found that the word2vec based query expansion methods perform similarly with and without any feedback information.

5 pages, 3 tables, 1 figure. Neu-IR '16 SIGIR Workshop on Neural Information Retrieval July 21, 2016, Pisa, Italy

Cited by in corpus (14)

• Query expansion techniques for information retrieval: A survey
• Semantic Models for the First-stage Retrieval: A Comprehensive Review
• Neural Models for Information Retrieval
• Bridging the Gap: Incorporating a Semantic Similarity Measure for Effectively Mapping PubMed Queries to Documents
• Neural Information Retrieval: A Literature Review
• A novel model for query expansion using pseudo-relevant web knowledge
• Task-Oriented Query Reformulation with Reinforcement Learning
• Learning to Match Using Local and Distributed Representations of Text for Web Search
• Pseudo Relevance Feedback with Deep Language Models and Dense Retrievers: Successes and Pitfalls
• Utilizing Embeddings for Ad-hoc Retrieval by Document-to-document Similarity
• Fake News Data Collection and Classification: Iterative Query Selection for Opaque Search Engines with Pseudo Relevance Feedback
• Event-Driven Query Expansion
• QA4PRF: A Question Answering based Framework for Pseudo Relevance Feedback
• ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation