CoulGAT: An Experiment on Interpretability of Graph Attention Networks
arXiv:1912.08409
Abstract
We present an attention mechanism inspired from definition of screened Coulomb potential. This attention mechanism was used to interpret the Graph Attention (GAT) model layers and training dataset by using a flexible and scalable framework (CoulGAT) developed for this purpose. Using CoulGAT, a forest of plain and resnet models were trained and characterized using this attention mechanism against CHAMPS dataset. The learnable variables of the attention mechanism are used to extract node-node and node-feature interactions to define an empirical standard model for the graph structure and hidden layer. This representation of graph and hidden layers can be used as a tool to compare different models, optimize hidden layers and extract a compact definition of graph structure of the dataset.
arXiv comment30 pages
References in corpus (6)
- Inductive Representation Learning on Large Graphs
- Neural Message Passing for Quantum Chemistry
- Deep Convolutional Networks on Graph-Structured Data
- Deep learning and the Schrödinger equation
- QCD potential as a "Coulomb-plus-linear" potential
- Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift