Discourse-Aware Rumour Stance Classification in Social Media Using Sequential Classifiers
arXiv:1712.02223 · doi:10.1016/j.ipm.2017.11.009
Abstract
Rumour stance classification, defined as classifying the stance of specific social media posts into one of supporting, denying, querying or commenting on an earlier post, is becoming of increasing interest to researchers. While most previous work has focused on using individual tweets as classifier inputs, here we report on the performance of sequential classifiers that exploit the discourse features inherent in social media interactions or 'conversational threads'. Testing the effectiveness of four sequential classifiers -- Hawkes Processes, Linear-Chain Conditional Random Fields (Linear CRF), Tree-Structured Conditional Random Fields (Tree CRF) and Long Short Term Memory networks (LSTM) -- on eight datasets associated with breaking news stories, and looking at different types of local and contextual features, our work sheds new light on the development of accurate stance classifiers. We show that sequential classifiers that exploit the use of discourse properties in social media conversations while using only local features, outperform non-sequential classifiers. Furthermore, we show that LSTM using a reduced set of features can outperform the other sequential classifiers; this performance is consistent across datasets and across types of stances. To conclude, our work also analyses the different features under study, identifying those that best help characterise and distinguish between stances, such as supporting tweets being more likely to be accompanied by evidence than denying tweets. We also set forth a number of directions for future research.
References in corpus (8)
- Distributed Representations of Words and Phrases and their Compositionality
- Theano: new features and speed improvements
- Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads
- Learning Reporting Dynamics during Breaking News for Rumour Detection in Social Media
- Breaking the News: First Impressions Matter on Online News
- Multiscale Event Detection in Social Media
- Using Gaussian Processes for Rumour Stance Classification in Social Media
- Microblog Analysis as a Programme of Work
Cited by in corpus (13)
- Stance Detection on Social Media: State of the Art and Trends
- FANG: Leveraging Social Context for Fake News Detection Using Graph Representation
- All-in-one: Multi-task Learning for Rumour Verification
- SciLens: Evaluating the Quality of Scientific News Articles Using Social Media and Scientific Literature Indicators
- Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detection
- MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims
- Explainable Rumor Detection using Inter and Intra-feature Attention Networks
- Semantic Representation and Inference for NLP
- Opinions are Made to be Changed: Temporally Adaptive Stance Classification
- Towards Explainable Fact Checking
- QMUL-SDS @ SardiStance: Leveraging Network Interactions to Boost Performance on Stance Detection using Knowledge Graphs
- Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages
- Mining Social Media for Newsgathering: A Review