Spatio-Temporal Sparsification for General Robust Graph Convolution Networks

Abstract

Graph Neural Networks (GNNs) have attracted increasing attention due to its successful applications on various graph-structure data. However, recent studies have shown that adversarial attacks are threatening the functionality of GNNs. Although numerous works have been proposed to defend adversarial attacks from various perspectives, most of them can be robust against the attacks only on specific scenarios. To address this shortage of robust generalization, we propose to defend the adversarial attacks on GNN through applying the Spatio-Temporal sparsification (called ST-Sparse) on the GNN hidden node representation. ST-Sparse is similar to the Dropout regularization in spirit. Through intensive experiment evaluation with GCN as the target GNN model, we identify the benefits of ST-Sparse as follows: (1) ST-Sparse shows the defense performance improvement in most cases, as it can effectively increase the robust accuracy by up to 6\% improvement; (2) ST-Sparse illustrates its robust generalization capability by integrating with the existing defense methods, similar to the integration of Dropout into various deep learning models as a standard regularization technique; (3) ST-Sparse also shows its ordinary generalization capability on clean datasets, in that ST-SparseGCN (the integration of ST-Sparse and the original GCN) even outperform the original GCN, while the other three representative defense methods are inferior to the original GCN.

References in corpus (14)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Graph Neural Networks: A Review of Methods and Applications
• Fast Graph Representation Learning with PyTorch Geometric
• Adversarial Attacks on Neural Networks for Graph Data
• Adversarial Attacks on Graph Neural Networks via Meta Learning
• Adversarial Attack and Defense on Graph Data: A Survey
• Adversarial Examples on Graph Data: Deep Insights into Attack and Defense
• Sparse DNNs with Improved Adversarial Robustness
• DeepRobust: A PyTorch Library for Adversarial Attacks and Defenses
• How Can We Be So Dense? The Benefits of Using Highly Sparse Representations
• Certifiable Robustness to Graph Perturbations
• Adversarial Attacks and Defenses on Graphs: A Review, A Tool and Empirical Studies
• Adversarial Defense Framework for Graph Neural Network
• The Search for Sparse, Robust Neural Networks