Improving Online Forums Summarization via Hierarchical Unified Deep Neural Network
arXiv:2103.13587
Abstract
Online discussion forums are prevalent and easily accessible, thus allowing people to share ideas and opinions by posting messages in the discussion threads. Forum threads that significantly grow in length can become difficult for participants, both newcomers and existing, to grasp main ideas. To mitigate this problem, this study aims to create an automatic text summarizer for online forums. We present Hierarchical Unified Deep Neural Network to build sentence and thread representations for the forum summarization. In this scheme, Bi-LSTM derives a representation that comprises information of the whole sentence and whole thread; whereas, CNN captures most informative features with respect to context from sentence and thread. Attention mechanism is applied on top of CNN to further highlight high-level representations that carry important information contributing to a desirable summary. Extensive performance evaluation has been conducted on three datasets, two of which are real-life online forums and one is news dataset. The results reveal that the proposed model outperforms several competitive baselines.
arXiv comment18 pages, 7 figures
References in corpus (8)
- Distributed Representations of Words and Phrases and their Compositionality
- ADADELTA: An Adaptive Learning Rate Method
- An overview of gradient descent optimization algorithms
- SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents
- Variations of the Similarity Function of TextRank for Automated Summarization
- ROUGE 2.0: Updated and Improved Measures for Evaluation of Summarization Tasks
- AttSum: Joint Learning of Focusing and Summarization with Neural Attention
- Improving Multi-Document Summarization via Text Classification