Self-supervised graph neural networks for accurate prediction of Néel temperature

Abstract

Antiferromagnetic materials are exciting quantum materials with rich physics and great potential for applications. It is highly demanded of the accurate and efficient theoretical method for determining the critical transition temperatures, Néel temperatures, of antiferromagnetic materials. The powerful graph neural networks (GNN) that succeed in predicting material properties lose their advantage in predicting magnetic properties due to the small dataset of magnetic materials, while conventional machine learning models heavily depend on the quality of material descriptors. We propose a new strategy to extract high-level material representations by utilizing self-supervised training of GNN on large-scale unlabeled datasets. According to the dimensional reduction analysis, we find that the learned knowledge about elements and magnetism transfers to the generated atomic vector representations. Compared with popular manually constructed descriptors and crystal graph convolutional neural networks, self-supervised material representations can help us obtain a more accurate and efficient model for Néel temperatures, and the trained model can successfully predict high Néel temperature antiferromagnetic materials. Our self-supervised GNN may serve as a universal pre-training framework for various material properties.

7 pages, 6 figures, 2 tables

References in corpus (13)

• Big Data of Materials Science - Critical Role of the Descriptor
• Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
• Quantum Anomalous Hall Effect in Graphene Proximity Coupled to an Antiferromagnetic Insulator
• Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning
• Orbital Graph Convolutional Neural Network for Material Property Prediction
• k=0 magnetic structure and absence of ferroelectricity in SmFeO3
• Projected Entangled Pair States at Finite Temperature: Imaginary Time Evolution with Ancillas
• Linearized Tensor Renormalization Group Algorithm for Thermodynamics of Quantum Lattice Models
• Few-shot machine learning in the three-dimensional Ising model
• The origin of exchange bias in multigranular non-collinear IrMn${}_3$/CoFe thin films
• Finite-temperature symmetric tensor network for spin-1/2 Heisenberg antiferromagnets on the square lattice
• Atomistic graph networks for experimental materials property prediction
• Network-Initialized Monte Carlo Based on Generative Neural Networks