Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Abstract

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models with affective information remains an area ripe for exploration. In this paper, we propose an extension to an LSTM (Long Short-Term Memory) language model for generating conversational text, conditioned on affect categories. Our proposed model, Affect-LM enables us to customize the degree of emotional content in generated sentences through an additional design parameter. Perception studies conducted using Amazon Mechanical Turk show that Affect-LM generates naturally looking emotional sentences without sacrificing grammatical correctness. Affect-LM also learns affect-discriminative word representations, and perplexity experiments show that additional affective information in conversational text can improve language model prediction.

References in corpus (3)

• Recurrent Neural Network Regularization
• Exploring the Limits of Language Modeling
• A Neural Knowledge Language Model

Cited by in corpus (13)

• Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory
• A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directions
• Neural Language Generation: Formulation, Methods, and Evaluation
• An End-to-End Network for Emotion-Cause Pair Extraction
• C5T5: Controllable Generation of Organic Molecules with Transformers
• Learning to Ask Questions in Open-domain Conversational Systems with Typed Decoders
• A Syntactically Constrained Bidirectional-Asynchronous Approach for Emotional Conversation Generation
• Affective Neural Response Generation
• Aff2Vec: Affect--Enriched Distributional Word Representations
• The Impact of Humanoid Affect Expression on Human Behavior in a Game-Theoretic Setting
• Towards Controlled and Diverse Generation of Article Comments
• Controllable Multi-Character Psychology-Oriented Story Generation
• Automatic Generation of Personalized Comment Based on User Profile