A C-LSTM Neural Network for Text Classification

Abstract

Neural network models have been demonstrated to be capable of achieving remarkable performance in sentence and document modeling. Convolutional neural network (CNN) and recurrent neural network (RNN) are two mainstream architectures for such modeling tasks, which adopt totally different ways of understanding natural languages. In this work, we combine the strengths of both architectures and propose a novel and unified model called C-LSTM for sentence representation and text classification. C-LSTM utilizes CNN to extract a sequence of higher-level phrase representations, and are fed into a long short-term memory recurrent neural network (LSTM) to obtain the sentence representation. C-LSTM is able to capture both local features of phrases as well as global and temporal sentence semantics. We evaluate the proposed architecture on sentiment classification and question classification tasks. The experimental results show that the C-LSTM outperforms both CNN and LSTM and can achieve excellent performance on these tasks.

References in corpus (6)

• Sequence to Sequence Learning with Neural Networks
• Natural Language Processing (almost) from Scratch
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Theano: new features and speed improvements
• When Are Tree Structures Necessary for Deep Learning of Representations?
• Modelling, Visualising and Summarising Documents with a Single Convolutional Neural Network

Cited by in corpus (80)

• Deep Learning Based Text Classification: A Comprehensive Review
• Quasi-Recurrent Neural Networks
• Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling
• A Benchmark Study of Machine Learning Models for Online Fake News Detection
• Natural Language Processing Advancements By Deep Learning: A Survey
• An ensemble deep learning technique for detecting suicidal ideation from posts in social media platforms
• Improving Deep Learning for HAR with shallow LSTMs
• Current Limitations in Cyberbullying Detection: on Evaluation Criteria, Reproducibility, and Data Scarcity
• CTRAN: CNN-Transformer-based Network for Natural Language Understanding
• BertGCN: Transductive Text Classification by Combining GCN and BERT
• Abstractive and Extractive Text Summarization using Document Context Vector and Recurrent Neural Networks
• Analyzing COVID-19 on Online Social Media: Trends, Sentiments and Emotions
• Shallow reading with Deep Learning: Predicting popularity of online content using only its title
• Interpreting Deep Learning Models in Natural Language Processing: A Review
• Neural Language Generation: Formulation, Methods, and Evaluation
• Corporate Bankruptcy Prediction with Domain-Adapted BERT
• Recognizing Explicit and Implicit Hate Speech Using a Weakly Supervised Two-path Bootstrapping Approach
• Antipatterns in Software Classification Taxonomies
• NewsEmbed: Modeling News through Pre-trained Document Representations
• Spatio-Temporal Fusion Networks for Action Recognition
• Abstractive Text Classification Using Sequence-to-convolution Neural Networks
• Emotion Detection in Text: Focusing on Latent Representation
• Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification
• Perceiving University Student's Opinions from Google App Reviews
• Text as Environment: A Deep Reinforcement Learning Text Readability Assessment Model
• On Sensitivity of Deep Learning Based Text Classification Algorithms to Practical Input Perturbations
• ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models
• Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging
• SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge
• Classifying YouTube Comments Based on Sentiment and Type of Sentence
• Cell-aware Stacked LSTMs for Modeling Sentences
• Analogical Reasoning for Visually Grounded Language Acquisition
• Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers
• Basic and Depression Specific Emotion Identification in Tweets: Multi-label Classification Experiments
• Deep Anomaly Detection in Packet Payload
• Detecting Radical Text over Online Media using Deep Learning
• Hierarchical CVAE for Fine-Grained Hate Speech Classification
• Polite Dialogue Generation Without Parallel Data
• TextNAS: A Neural Architecture Search Space tailored for Text Representation
• Generic Multilayer Network Data Analysis with the Fusion of Content and Structure
• Improving Medical Short Text Classification with Semantic Expansion Using Word-Cluster Embedding
• Deep Insights into Cognitive Decline: A Survey of Leveraging Non-Intrusive Modalities with Deep Learning Techniques
• Deep Search Query Intent Understanding
• HARPO: Learning to Subvert Online Behavioral Advertising
• Weighted graphlets and deep neural networks for protein structure classification
• Neurlux: Dynamic Malware Analysis Without Feature Engineering
• NSL: Hybrid Interpretable Learning From Noisy Raw Data
• Integrated Eojeol Embedding for Erroneous Sentence Classification in Korean Chatbots
• Incorporating Effective Global Information via Adaptive Gate Attention for Text Classification
• Benchmark Performance of Machine And Deep Learning Based Methodologies for Urdu Text Document Classification
• Development of deep learning algorithms to categorize free-text notes pertaining to diabetes: convolution neural networks achieve higher accuracy than support vector machines
• A Comprehensive Low and High-level Feature Analysis for Early Rumor Detection on Twitter
• On Early-stage Debunking Rumors on Twitter: Leveraging the Wisdom of Weak Learners
• Sequential Targeting: an incremental learning approach for data imbalance in text classification
• Cross-lingual Data Transformation and Combination for Text Classification
• Minimally Supervised Categorization of Text with Metadata
• Comparing Attention-based Convolutional and Recurrent Neural Networks: Success and Limitations in Machine Reading Comprehension
• Improving the Robustness to Data Inconsistency between Training and Testing for Code Completion by Hierarchical Language Model
• Improve Language Modelling for Code Completion through Statement Level Language Model based on Statement Embedding Generated by BiLSTM
• Multi-label Categorization of Accounts of Sexism using a Neural Framework
• Genetic Sequence compression using Machine Learning and Arithmetic Encoding Decoding Techniques
• Movie Box office Prediction via Joint Actor Representations and Social Media Sentiment
• Self-supervised Regularization for Text Classification
• TechTexC: Classification of Technical Texts using Convolution and Bidirectional Long Short Term Memory Network
• Tweets Can Tell: Activity Recognition using Hybrid Long Short-Term Memory Model
• Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion
• Relation Detection for Indonesian Language using Deep Neural Network -- Support Vector Machine
• CIKM AnalytiCup 2017 Lazada Product Title Quality Challenge An Ensemble of Deep and Shallow Learning to predict the Quality of Product Titles
• DeepHelp: Deep Learning for Shout Crisis Text Conversations
• Patient Risk Assessment and Warning Symptom Detection Using Deep Attention-Based Neural Networks
• Read Beyond the Lines: Understanding the Implied Textual Meaning via a Skim and Intensive Reading Model
• A Comparative Study of Sequence Classification Models for Privacy Policy Coverage Analysis
• TextZoo, a New Benchmark for Reconsidering Text Classification
• Conversational Help for Task Completion and Feature Discovery in Personal Assistants
• Humanly Certifying Superhuman Classifiers
• Semantic Relatedness Based Re-ranker for Text Spotting
• Sequential Learning of Convolutional Features for Effective Text Classification
• Recurrent Neural Network Language Model Adaptation Derived Document Vector
• Supervised Sentiment Classification with CNNs for Diverse SE Datasets
• Joint Embedding of Words and Category Labels for Hierarchical Multi-label Text Classification