Deep Contrastive Graph Representation via Adaptive Homotopy Learning
arXiv:2106.09244
Abstract
Homotopy model is an excellent tool exploited by diverse research works in the field of machine learning. However, its flexibility is limited due to lack of adaptiveness, i.e., manual fixing or tuning the appropriate homotopy coefficients. To address the problem above, we propose a novel adaptive homotopy framework (AH) in which the Maclaurin duality is employed, such that the homotopy parameters can be adaptively obtained. Accordingly, the proposed AH can be widely utilized to enhance the homotopy-based algorithm. In particular, in this paper, we apply AH to contrastive learning (AHCL) such that it can be effectively transferred from weak-supervised learning (given label priori) to unsupervised learning, where soft labels of contrastive learning are directly and adaptively learned. Accordingly, AHCL has the adaptive ability to extract deep features without any sort of prior information. Consequently, the affinity matrix formulated by the related adaptive labels can be constructed as the deep Laplacian graph that incorporates the topology of deep representations for the inputs. Eventually, extensive experiments on benchmark datasets validate the superiority of our method.
arXiv comment9 pages,4 figures
References in corpus (12)
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Bootstrap your own latent: A new approach to self-supervised Learning
- Data-Efficient Image Recognition with Contrastive Predictive Coding
- Variational Graph Auto-Encoders
- Prototypical Contrastive Learning of Unsupervised Representations
- Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID
- SpectralNet: Spectral Clustering using Deep Neural Networks
- Self-labelling via simultaneous clustering and representation learning
- Adversarial Self-Supervised Contrastive Learning
- Understanding Regularized Spectral Clustering via Graph Conductance
- Training Recurrent Neural Networks by Diffusion
- Adaptive Graph Auto-Encoder for General Data Clustering