Materials Representation and Transfer Learning for Multi-Property Prediction

Abstract

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements, as well as the relationships among multiple properties, to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates (i) prediction using only a material's composition, (ii) learning and exploitation of correlations among target properties in multi-target regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 3-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data is available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with Transfer learning (H-CLMP(T)) wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well-suited for multi-target regression across the physical sciences.

arXiv commentThis is accepted at the Applied Physics Reviews journal

References in corpus (21)

• Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties
• SchNet - a deep learning architecture for molecules and materials
• A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials
• Molecular Graph Convolutions: Moving Beyond Fingerprints
• Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals
• Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model
• Self-Referencing Embedded Strings (SELFIES): A 100% robust molecular string representation
• On-the-fly Closed-loop Autonomous Materials Discovery via Bayesian Active Learning
• Predicting materials properties without crystal structure: Deep representation learning from stoichiometry
• Large-scale Multi-label Learning with Missing Labels
• Representation of compounds for machine-learning prediction of physical properties
• Developing an improved Crystal Graph Convolutional Neural Network framework for accelerated materials discovery
• Global Attention based Graph Convolutional Neural Networks for Improved Materials Property Prediction
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• Learning Properties of Ordered and Disordered Materials from Multi-fidelity Data
• Searching for Materials with High Refractive Index and Wide Band Gap: A First-Principles High-Throughput Study
• Predicting Elastic Properties of Materials from Electronic Charge Density Using 3D Deep Convolutional Neural Networks
• Disentangled Variational Autoencoder based Multi-Label Classification with Covariance-Aware Multivariate Probit Model
• Efficient Estimation of Material Property Curves and Surfaces via Active Learning
• End-to-End Learning for the Deep Multivariate Probit Model
• Neural Message Passing for Multi-Label Classification

Cited by in corpus (9)

• RadonPy: Automated Physical Property Calculation using All-atom Classical Molecular Dynamics Simulations for Polymer Informatics
• Density of States Prediction for Materials Discovery via Contrastive Learning from Probabilistic Embeddings
• Artificial Intelligence in Material Engineering: A review on applications of AI in Material Engineering
• Calibrating DFT formation enthalpy calculations by multi-fidelity machine learning
• Formula graph self-attention network for representation-domain independent materials discovery
• Benchmarking Inverse Optimization Algorithms for Materials Design
• Emerging Microelectronic Materials by Design: Navigating Combinatorial Design Space with Scarce and Dispersed Data
• Assessment of the synthetic feasibility of hypothetical zeolite-like materials based on ZeoNet
• A New Workflow for Materials Discovery Bridging the Gap Between Experimental Databases and Graph Neural Networks