An Information Retrieval Approach to Short Text Conversation

Abstract

Human computer conversation is regarded as one of the most difficult problems in artificial intelligence. In this paper, we address one of its key sub-problems, referred to as short text conversation, in which given a message from human, the computer returns a reasonable response to the message. We leverage the vast amount of short conversation data available on social media to study the issue. We propose formalizing short text conversation as a search problem at the first step, and employing state-of-the-art information retrieval (IR) techniques to carry out the task. We investigate the significance as well as the limitation of the IR approach. Our experiments demonstrate that the retrieval-based model can make the system behave rather "intelligently", when combined with a huge repository of conversation data from social media.

21 pages, 4 figures

Cited by in corpus (51)

• Natural Language Processing Advancements By Deep Learning: A Survey
• Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems
• Two are Better than One: An Ensemble of Retrieval- and Generation-Based Dialog Systems
• Training Neural Response Selection for Task-Oriented Dialogue Systems
• Challenges in Building Intelligent Open-domain Dialog Systems
• Multiresolution Graph Attention Networks for Relevance Matching
• Enhance word representation for out-of-vocabulary on Ubuntu dialogue corpus
• StalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer Conversation
• A Hybrid Retrieval-Generation Neural Conversation Model
• Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
• Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction
• Retrieve and Refine: Improved Sequence Generation Models For Dialogue
• Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion
• Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memory
• A Deep Look into Neural Ranking Models for Information Retrieval
• Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
• A Re-classification of Information Seeking Tasks and Their Computational Solutions
• DAL: Dual Adversarial Learning for Dialogue Generation
• Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
• Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems
• An Enhanced Knowledge Injection Model for Commonsense Generation
• Discovering Dialog Structure Graph for Open-Domain Dialog Generation
• Retrieval-Enhanced Adversarial Training for Neural Response Generation
• Improving Retrieval Modeling Using Cross Convolution Networks And Multi Frequency Word Embedding
• A Sequential Matching Framework for Multi-turn Response Selection in Retrieval-based Chatbots
• A Document-grounded Matching Network for Response Selection in Retrieval-based Chatbots
• The World is Not Binary: Learning to Rank with Grayscale Data for Dialogue Response Selection
• Fine-Grained Sentence Functions for Short-Text Conversation
• Target Guided Emotion Aware Chat Machine
• Automating App Review Response Generation Based on Contextual Knowledge
• Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
• Towards Automatic Generation of Entertaining Dialogues in Chinese Crosstalks
• Content Selection Network for Document-grounded Retrieval-based Chatbots
• Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning
• Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridging
• RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
• Counterfactual Off-Policy Training for Neural Response Generation
• Weakly-Supervised Neural Response Selection from an Ensemble of Task-Specialised Dialogue Agents
• Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
• Achieving Fluency and Coherency in Task-oriented Dialog
• Improving Multi-Turn Response Selection Models with Complementary Last-Utterance Selection by Instance Weighting
• Addressee and Response Selection for Multilingual Conversation
• Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection
• Improv Chat: Second Response Generation for Chatbot
• Predict and Use Latent Patterns for Short-Text Conversation
• Distilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation
• Automating App Review Response Generation
• A Robotic Dating Coaching System Leveraging Online Communities Posts
• Unsupervised Context Rewriting for Open Domain Conversation
• Data-Efficient Methods for Dialogue Systems