Exploiting Heterogeneous Graph Neural Networks with Latent Worker/Task Correlation Information for Label Aggregation in Crowdsourcing

Abstract

Crowdsourcing has attracted much attention for its convenience to collect labels from non-expert workers instead of experts. However, due to the high level of noise from the non-experts, an aggregation model that learns the true label by incorporating the source credibility is required. In this paper, we propose a novel framework based on graph neural networks for aggregating crowd labels. We construct a heterogeneous graph between workers and tasks and derive a new graph neural network to learn the representations of nodes and the true labels. Besides, we exploit the unknown latent interaction between the same type of nodes (workers or tasks) by adding a homogeneous attention layer in the graph neural networks. Experimental results on 13 real-world datasets show superior performance over state-of-the-art models.

arXiv commentAccepted by TKDD

References in corpus (9)

• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Modeling polypharmacy side effects with graph convolutional networks
• Graph Neural Networks: A Review of Methods and Applications
• Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddings
• CrowdER: Crowdsourcing Entity Resolution
• Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation
• Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds