Context-aware Natural Language Generation with Recurrent Neural Networks
arXiv:1611.09900
Abstract
This paper studied generating natural languages at particular contexts or situations. We proposed two novel approaches which encode the contexts into a continuous semantic representation and then decode the semantic representation into text sequences with recurrent neural networks. During decoding, the context information are attended through a gating mechanism, addressing the problem of long-range dependency caused by lengthy sequences. We evaluate the effectiveness of the proposed approaches on user review data, in which rich contexts are available and two informative contexts, sentiments and products, are selected for evaluation. Experiments show that the fake reviews generated by our approaches are very natural. Results of fake review detection with human judges show that more than 50\% of the fake reviews are misclassified as the real reviews, and more than 90\% are misclassified by existing state-of-the-art fake review detection algorithm.
References in corpus (1)
Cited by in corpus (5)
- Assessing the Stylistic Properties of Neurally Generated Text in Authorship Attribution
- Automatic Generation of Natural Language Explanations
- A Hierarchical Attention Based Seq2seq Model for Chinese Lyrics Generation
- SAM: Semantic Attribute Modulation for Language Modeling and Style Variation
- AI-Powered Text Generation for Harmonious Human-Machine Interaction: Current State and Future Directions