Benchmark tests of atom segmentation deep learning models with a consistent dataset

Abstract

The information content of atomic resolution scanning transmission electron microscopy (STEM) images can often be reduced to a handful of parameters describing each atomic column, chief amongst which is the column position. Neural networks (NNs) are a high performance, computationally efficient method to automatically locate atomic columns in images, which has led to a profusion of NN models and associated training datasets. We have developed a benchmark dataset of simulated and experimental STEM images and used it to evaluate the performance of two sets of recent NN models for atom location in STEM images. Both models exhibit high performance for images of varying quality from several different crystal lattices. However, there are important differences in performance as a function of image quality, and both models perform poorly for images outside the training data, such as interfaces with large difference in background intensity. Both the benchmark dataset and the models are available using the Foundry service for dissemination, discovery, and reuse of machine learning models.

References in corpus (5)

• Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations
• A Deep Learning Based Automatic Defect Analysis Framework for In-situ TEM Ion Irradiations
• Exploring order parameters and dynamic processes in disordered systems via variational autoencoders
• Multi defect detection and analysis of electron microscopy images with deep learning
• Exploring particle dynamics during self-organization processes via rotationally invariant latent representations

Cited by in corpus (2)

• JARVIS-Leaderboard: A Large Scale Benchmark of Materials Design Methods
• Mic-hackathon 2024: Hackathon on Machine Learning for Electron and Scanning Probe Microscopy