Atom2Vec: learning atoms for materials discovery

Abstract

Exciting advances have been made in artificial intelligence (AI) during the past decades. Among them, applications of machine learning (ML) and deep learning techniques brought human-competitive performances in various tasks of fields, including image recognition, speech recognition and natural language understanding. Even in Go, the ancient game of profound complexity, the AI player already beat human world champions convincingly with and without learning from human. In this work, we show that our unsupervised machines (Atom2Vec) can learn the basic properties of atoms by themselves from the extensive database of known compounds and materials. These learned properties are represented in terms of high dimensional vectors, and clustering of atoms in vector space classifies them into meaningful groups in consistent with human knowledge. We use the atom vectors as basic input units for neural networks and other ML models designed and trained to predict materials properties, which demonstrate significant accuracy.

arXiv comment8 pages, 4 figures

References in corpus (9)

• Sequence to Sequence Learning with Neural Networks
• Neural Message Passing for Quantum Chemistry
• Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
• Molecular Graph Convolutions: Moving Beyond Fingerprints
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Big Data of Materials Science - Critical Role of the Descriptor
• Tunable Multifunctional Topological Insulators in Ternary Heusler Compounds
• Machine learning prediction errors better than DFT accuracy
• Machine Learning Energies of 2 M Elpasolite (ABC${}_2$D${}_6$) Crystals

Cited by in corpus (29)

• Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals
• Recent Advances and Applications of Deep Learning Methods in Materials Science
• Predicting materials properties without crystal structure: Deep representation learning from stoichiometry
• Autonomous discovery in the chemical sciences part II: Outlook
• Machine-Learning Interatomic Potentials Enable First-Principles Multiscale Modeling of Lattice Thermal Conductivity in Graphene/Borophene Heterostructures
• Strategies for Pre-training Graph Neural Networks
• Orbital Graph Convolutional Neural Network for Material Property Prediction
• High-throughput discovery of novel cubic crystal materials using deep generative neural networks
• Graph Dynamical Networks for Unsupervised Learning of Atomic Scale Dynamics in Materials
• Feature Optimization for Atomistic Machine Learning Yields A Data-Driven Construction of the Periodic Table of the Elements
• Machine-Learning X-ray Absorption Spectra to Quantitative Accuracy
• Band gap prediction for large organic crystal structures with machine learning
• Predicting new superconductors and their critical temperatures using unsupervised machine learning
• Hierarchical Visualization of Materials Space with Graph Convolutional Neural Networks
• Artificial Intelligence in Material Engineering: A review on applications of AI in Material Engineering
• IRNet: A General Purpose Deep Residual Regression Framework for Materials Discovery
• Structure motif centric learning framework for inorganic crystalline systems
• Sensitivity and Dimensionality of Atomic Environment Representations used for Machine Learning Interatomic Potentials
• Detecting signal from science:The structure of research communities and prior knowledge improves prediction of genetic regulatory experiments
• Materials Fingerprinting Classification
• Optimizing persistent currents in a ring-shaped Bose-Einstein condensate using machine learning
• Compressing physical properties of atomic species for improving predictive chemistry
• Space Group Informed Transformer for Crystalline Materials Generation
• Transfer Learning for Scientific Data Chain Extraction in Small Chemical Corpus with BERT-CRF Model
• Bridging Text and Crystal Structures: Literature-driven Contrastive Learning for Materials Science
• Active learning and element embedding approach in neural networks for infinite-layer versus perovskite oxides
• Predicting Material Properties Using a 3D Graph Neural Network with Invariant Local Descriptors
• AI Discovering a Coordinate System of Chemical Elements: Dual Representation by Variational Autoencoders
• To See a World in a Grain of Sand -- The Scientific Life of Shoucheng Zhang