On the redundancy in large material datasets: efficient and robust learning with less data

Abstract

Extensive efforts to gather materials data have largely overlooked potential data redundancy. In this study, we present evidence of a significant degree of redundancy across multiple large datasets for various material properties, by revealing that up to 95 % of data can be safely removed from machine learning training with little impact on in-distribution prediction performance. The redundant data is related to over-represented material types and does not mitigate the severe performance degradation on out-of-distribution samples. In addition, we show that uncertainty-based active learning algorithms can construct much smaller but equally informative datasets. We discuss the effectiveness of informative data in improving prediction performance and robustness and provide insights into efficient data acquisition and machine learning training. This work challenges the "bigger is better" mentality and calls for attention to the information richness of materials data rather than a narrow emphasis on data volume.

Main text: 9 pages, 2 tables, 6 figures. Supplemental information: 31 pages, 1 table, 24 figures

References in corpus (4)

• Opportunities and Challenges for Machine Learning in Materials Science
• A critical examination of robustness and generalizability of machine learning prediction of materials properties
• On the redundancy in large material datasets: efficient and robust learning with less data
• ET-AL: Entropy-Targeted Active Learning for Bias Mitigation in Materials Data

Cited by in corpus (9)

• On the redundancy in large material datasets: efficient and robust learning with less data
• Probing out-of-distribution generalization in machine learning for materials
• JARVIS-Leaderboard: A Large Scale Benchmark of Materials Design Methods
• Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theory
• Efficient first principles based modeling via machine learning: from simple representations to high entropy materials
• Emerging Microelectronic Materials by Design: Navigating Combinatorial Design Space with Scarce and Dispersed Data
• FibreCastML: An Open Web Platform for Predicting Electrospun Nanofibre Diameter Distributions
• Do Graph Neural Networks Work for High Entropy Alloys?
• Design of a specimen to train path-dependent deep learning material models from a single uniaxial test: eliciting strain diversity via automatically differentiable elastoplastic topology optimization