Scalable Global Alignment Graph Kernel Using Random Features: From Node Embedding to Graph Embedding
arXiv:1911.11119
Abstract
Graph kernels are widely used for measuring the similarity between graphs. Many existing graph kernels, which focus on local patterns within graphs rather than their global properties, suffer from significant structure information loss when representing graphs. Some recent global graph kernels, which utilizes the alignment of geometric node embeddings of graphs, yield state-of-the-art performance. However, these graph kernels are not necessarily positive-definite. More importantly, computing the graph kernel matrix will have at least quadratic {time} complexity in terms of the number and the size of the graphs. In this paper, we propose a new family of global alignment graph kernels, which take into account the global properties of graphs by using geometric node embeddings and an associated node transportation based on earth mover's distance. Compared to existing global kernels, the proposed kernel is positive-definite. Our graph kernel is obtained by defining a distribution over \emph{random graphs}, which can naturally yield random feature approximations. The random feature approximations lead to our graph embeddings, which is named as "random graph embeddings" (RGE). In particular, RGE is shown to achieve \emph{(quasi-)linear scalability} with respect to the number and the size of the graphs. The experimental results on nine benchmark datasets demonstrate that RGE outperforms or matches twelve state-of-the-art graph classification algorithms.
KDD'19, Oral Paper, Data and Code link available in the paper
References in corpus (9)
- Generalization Properties of Learning with Random Features
- On Valid Optimal Assignment Kernels and Applications to Graph Classification
- The Multiscale Laplacian Graph Kernel
- DDGK: Learning Graph Representations for Deep Divergence Graph Kernels
- D2KE: From Distance to Kernel and Embedding
- Continuous-Flow Graph Transportation Distances
- Random Warping Series: A Random Features Method for Time-Series Embedding
- Sparse Diffusion-Convolutional Neural Networks
- DGCNN: Disordered Graph Convolutional Neural Network Based on the Gaussian Mixture Model