Revealing the Evolution of Order in Materials Microstructures Using Multi-Modal Computer Vision

Abstract

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La${}_{1-x}$Sr${}_x$FeO${}_3$. We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

30 pages, 5 figures, 2 tables

References in corpus (19)

• MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation
• Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review
• AtomAI: A Deep Learning Framework for Analysis of Image and Spectroscopy Data in (Scanning) Transmission Electron Microscopy and Beyond
• Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy
• Machine Learning Pipeline for Segmentation and Defect Identification from High Resolution Transmission Electron Microscopy Data
• A Comprehensive and Versatile Multimodal Deep Learning Approach for Predicting Diverse Properties of Advanced Materials
• STEM image analysis based on deep learning: identification of vacancy defects and polymorphs of $Mo{S}_2$
• An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics
• Measurement Error in Atomic-Scale STEM-EDS Mapping of a Model Oxide Interface
• Thickness Dependent OER Electrocatalysis of Epitaxial LaFeO${}_3$ Thin Films
• Imaging Atomic-Scale Chemistry from Fused Multi-Modal Electron Microscopy
• Understanding the Influence of Receptive Field and Network Complexity in Neural-Network-Guided TEM Image Analysis
• Asymmetric Lattice Disorder Induced at Oxide Interfaces
• Assessing electron beam sensitivity for SrTiO${}_3$ and La${}_{0.7}$Sr${}_{0.3}$MnO${}_3$ using electron energy loss spectroscopy
• Resolving diverse oxygen transport pathways across Sr-doped lanthanum ferrite and metal-perovskite heterostructures
• Percolation of Ion-Irradiation-Induced Disorder in Complex Oxide Interfaces
• Effect of structure and composition on the electronic excitation induced amorphization of La${}_2$Ti${}_{2-x}$Zr${}_x$O${}_7$ ceramics
• DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering
• The landscape of ontologies in materials science and engineering: A survey and evaluation