Learning-based Defect Recognition for Quasi-Periodic Microscope Images
arXiv:2007.01309 · doi:10.1016/j.micron.2021.103069
Abstract
Controlling crystalline material defects is crucial, as they affect properties of the material that may be detrimental or beneficial for the final performance of a device. Defect analysis on the sub-nanometer scale is enabled by high-resolution (scanning) transmission electron microscopy [HR(S)TEM], where the identification of defects is currently carried out based on human expertise. However, the process is tedious, highly time consuming and, in some cases, yields ambiguous results. Here we propose a semi-supervised machine learning method that assists in the detection of lattice defects from atomic resolution microscope images. It involves a convolutional neural network that classifies image patches as defective or non-defective, a graph-based heuristic that chooses one non-defective patch as a model, and finally an automatically generated convolutional filter bank, which highlights symmetry breaking such as stacking faults, twin defects and grain boundaries. Additionally, we suggest a variance filter to segment amorphous regions and beam defects. The algorithm is tested on III-V/Si crystalline materials and successfully evaluated against different metrics, showing promising results even for extremely small training data sets. By combining the data-driven classification generality, robustness and speed of deep learning with the effectiveness of image filters in segmenting faulty symmetry arrangements, we provide a valuable open-source tool to the microscopist community that can streamline future HR(S)TEM analyses of crystalline materials.
arXiv comment11 pages + references and appendix, 5 figures. V2: Added references. Corrected typos. Elaborated methodology. In sample figure, replaced grain boundary image with more representative image. Results are unchanged
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Fully Convolutional Networks for Semantic Segmentation
- LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
- Fully Convolutional Networks for Semantic Segmentation
- A Replica Inference Approach to Unsupervised Multi-Scale Image Segmentation
- Automatic microscopic image analysis by moving window local Fourier Transform and Machine Learning
- Can we unify monocular detectors for autonomous driving by using the pixel-wise semantic segmentation of CNNs?