OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contexts

Abstract

In order to better simulate the real human conversation process, models need to generate dialogue utterances based on not only preceding textual contexts but also visual contexts. However, with the development of multi-modal dialogue learning, the dataset scale gradually becomes a bottleneck. In this report, we release OpenViDial 2.0, a larger-scale open-domain multi-modal dialogue dataset compared to the previous version OpenViDial 1.0. OpenViDial 2.0 contains a total number of 5.6 million dialogue turns extracted from either movies or TV series from different resources, and each dialogue turn is paired with its corresponding visual context. We hope this large-scale dataset can help facilitate future researches on open-domain multi-modal dialog generation, e.g., multi-modal pretraining for dialogue generation.

References in corpus (28)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• A Neural Conversational Model
• Deep Reinforcement Learning for Dialogue Generation
• Chameleons in imagined conversations: A new approach to understanding coordination of linguistic style in dialogs
• Towards a Human-like Open-Domain Chatbot
• Adversarial Learning for Neural Dialogue Generation
• Personalizing Dialogue Agents: I have a dog, do you have pets too?
• Data Noising as Smoothing in Neural Network Language Models
• Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders
• Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory
• DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
• Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning
• Visual Reference Resolution using Attention Memory for Visual Dialog
• A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
• DP-GAN: Diversity-Promoting Generative Adversarial Network for Generating Informative and Diversified Text
• CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog
• ConvLab: Multi-Domain End-to-End Dialog System Platform
• Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems
• Rethinking Action Spaces for Reinforcement Learning in End-to-end Dialog Agents with Latent Variable Models
• Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions
• Generating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Models
• OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts
• FlipDial: A Generative Model for Two-Way Visual Dialogue
• Modeling Text-visual Mutual Dependency for Multi-modal Dialog Generation
• Dual Attention Networks for Visual Reference Resolution in Visual Dialog
• Making History Matter: History-Advantage Sequence Training for Visual Dialog
• Non-Autoregressive Neural Dialogue Generation
• Teaching Machines to Converse