Neural Message Passing for Multi-Label Classification
arXiv:1904.08049
Abstract
Multi-label classification (MLC) is the task of assigning a set of target labels for a given sample. Modeling the combinatorial label interactions in MLC has been a long-haul challenge. We propose Label Message Passing (LaMP) Neural Networks to efficiently model the joint prediction of multiple labels. LaMP treats labels as nodes on a label-interaction graph and computes the hidden representation of each label node conditioned on the input using attention-based neural message passing. Attention enables LaMP to assign different importance to neighbor nodes per label, learning how labels interact (implicitly). The proposed models are simple, accurate, interpretable, structure-agnostic, and applicable for predicting dense labels since LaMP is incredibly parallelizable. We validate the benefits of LaMP on seven real-world MLC datasets, covering a broad spectrum of input/output types and outperforming the state-of-the-art results. Notably, LaMP enables intuitive interpretation of how classifying each label depends on the elements of a sample and at the same time rely on its interaction with other labels. We provide our code and datasets at https://github.com/QData/LaMP
19pages. We provide our code and datasets at https://github.com/QData/LaMP
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- Semi-Supervised Classification with Graph Convolutional Networks
- Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
- Molecular Graph Convolutions: Moving Beyond Fingerprints
- Non-Autoregressive Neural Machine Translation
- Discriminative Embeddings of Latent Variable Models for Structured Data
- Gated Graph Sequence Neural Networks
- Order Matters: Sequence to sequence for sets
- Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networks
- Learning Approximate Inference Networks for Structured Prediction
- Deep Value Networks Learn to Evaluate and Iteratively Refine Structured Outputs
- Attentional Multilabel Learning over Graphs: A Message Passing Approach