Deep Graph-level Anomaly Detection by Glocal Knowledge Distillation

Abstract

Graph-level anomaly detection (GAD) describes the problem of detecting graphs that are abnormal in their structure and/or the features of their nodes, as compared to other graphs. One of the challenges in GAD is to devise graph representations that enable the detection of both locally- and globally-anomalous graphs, i.e., graphs that are abnormal in their fine-grained (node-level) or holistic (graph-level) properties, respectively. To tackle this challenge we introduce a novel deep anomaly detection approach for GAD that learns rich global and local normal pattern information by joint random distillation of graph and node representations. The random distillation is achieved by training one GNN to predict another GNN with randomly initialized network weights. Extensive experiments on 16 real-world graph datasets from diverse domains show that our model significantly outperforms seven state-of-the-art models. Code and datasets are available at https://git.io/GLocalKD.

arXiv commentAccepted to WSDM 2022

References in corpus (8)

• Distilling the Knowledge in a Neural Network
• A Comprehensive Survey on Graph Neural Networks
• Deep Learning for Anomaly Detection: A Review
• Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings
• graph2vec: Learning Distributed Representations of Graphs
• Learning Deep Features for One-Class Classification
• Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection
• Randomized Prior Functions for Deep Reinforcement Learning

Cited by in corpus (10)

• Deep Isolation Forest for Anomaly Detection
• Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation
• Soft Prompt Decoding for Multilingual Dense Retrieval
• CVTGAD: Simplified Transformer with Cross-View Attention for Unsupervised Graph-level Anomaly Detection
• Pattern Mining for Anomaly Detection in Graphs: Application to Fraud in Public Procurement
• Motif-Consistent Counterfactuals with Adversarial Refinement for Graph-Level Anomaly Detection
• Multi-representations Space Separation based Graph-level Anomaly-aware Detection
• GLADMamba: Unsupervised Graph-Level Anomaly Detection Powered by Selective State Space Model
• Imbalanced Graph-Level Anomaly Detection via Counterfactual Augmentation and Feature Learning
• Extreme Value Modelling of Feature Residuals for Anomaly Detection in Dynamic Graphs