Towards Controlled and Diverse Generation of Article Comments
arXiv:2107.11781
Abstract
Much research in recent years has focused on automatic article commenting. However, few of previous studies focus on the controllable generation of comments. Besides, they tend to generate dull and commonplace comments, which further limits their practical application. In this paper, we make the first step towards controllable generation of comments, by building a system that can explicitly control the emotion of the generated comments. To achieve this, we associate each kind of emotion category with an embedding and adopt a dynamic fusion mechanism to fuse this embedding into the decoder. A sentence-level emotion classifier is further employed to better guide the model to generate comments expressing the desired emotion. To increase the diversity of the generated comments, we propose a hierarchical copy mechanism that allows our model to directly copy words from the input articles. We also propose a restricted beam search (RBS) algorithm to increase intra-sentence diversity. Experimental results show that our model can generate informative and diverse comments that express the desired emotions with high accuracy.
References in corpus (14)
- Adam: A Method for Stochastic Optimization
- Sequence to Sequence Learning with Neural Networks
- Improving neural networks by preventing co-adaptation of feature detectors
- A Deep Reinforced Model for Abstractive Summarization
- Get To The Point: Summarization with Pointer-Generator Networks
- Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting
- Global Encoding for Abstractive Summarization
- Affect-LM: A Neural Language Model for Customizable Affective Text Generation
- Is Word Segmentation Necessary for Deep Learning of Chinese Representations?
- Generating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Models
- Automatic Article Commenting: the Task and Dataset
- Coherent Comment Generation for Chinese Articles with a Graph-to-Sequence Model
- Unsupervised Machine Commenting with Neural Variational Topic Model
- Learning Comment Generation by Leveraging User-Generated Data