Machine learning of microstructure--property relationships in materials leveraging microstructure representation from foundational vision transformers
arXiv:2501.18637 · doi:10.1016/j.actamat.2025.121217
Abstract
Machine learning of microstructure--property relationships from data is an emerging approach in computational materials science. Most existing machine learning efforts focus on the development of task-specific models for each microstructure--property relationship. We propose utilizing pre-trained foundational vision transformers for the extraction of task-agnostic microstructure features and subsequent light-weight machine learning of a microstructure-dependent property. We demonstrate our approach with pre-trained state-of-the-art vision transformers (CLIP, DINOv2, SAM) in two case studies on machine-learning: (i) elastic modulus of two-phase microstructures based on simulations data; and (ii) Vicker's hardness of Ni-base and Co-base superalloys based on experimental data published in literature. Our results show the potential of foundational vision transformers for robust microstructure representation and efficient machine learning of microstructure--property relationships without the need for expensive task-specific training or fine-tuning of bespoke deep learning models.
References in corpus (8)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- DINOv2: Learning Robust Visual Features without Supervision
- Modeling Heterogeneous Materials via Two-Point Correlation Functions: I. Basic Principles
- Materials knowledge system for nonlinear composites
- FIP-GNN: Graph neural networks for scalable prediction of grain-level fatigue indicator parameters
- Learning from 2D: machine learning of 3D effective properties of heterogeneous materials based on 2D microstructure sections
- Adaptive Layer Selection for Efficient Vision Transformer Fine-Tuning