A non-hierarchical attention network with modality dropout for textual response generation in multimodal dialogue systems

Rongyi Sun, Borun Chen, Qingyu Zhou +3

Existing text- and image-based multimodal dialogue systems use the traditional Hierarchical Recurrent Encoder-Decoder (HRED) framework, which has an utterance-level encoder to mode…