Hierarchical Metadata-Aware Document Categorization under Weak Supervision
arXiv:2010.13556
Abstract
Categorizing documents into a given label hierarchy is intuitively appealing due to the ubiquity of hierarchical topic structures in massive text corpora. Although related studies have achieved satisfying performance in fully supervised hierarchical document classification, they usually require massive human-annotated training data and only utilize text information. However, in many domains, (1) annotations are quite expensive where very few training samples can be acquired; (2) documents are accompanied by metadata information. Hence, this paper studies how to integrate the label hierarchy, metadata, and text signals for document categorization under weak supervision. We develop HiMeCat, an embedding-based generative framework for our task. Specifically, we propose a novel joint representation learning module that allows simultaneous modeling of category dependencies, metadata information and textual semantics, and we introduce a data augmentation module that hierarchically synthesizes training documents to complement the original, small-scale training set. Our experiments demonstrate a consistent improvement of HiMeCat over competitive baselines and validate the contribution of our representation learning and data augmentation modules.
arXiv comment9 pages; Accepted to WSDM 2021
References in corpus (7)
- Distributed Representations of Words and Phrases and their Compositionality
- Meta-Path Guided Embedding for Similarity Search in Large-Scale Heterogeneous Information Networks
- Hierarchical Text Classification with Reinforced Label Assignment
- Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputs
- Spherical Text Embedding
- Heterogeneous Network Representation Learning: A Unified Framework with Survey and Benchmark
- Efficient Path Prediction for Semi-Supervised and Weakly Supervised Hierarchical Text Classification