Error Assessment of Computational Models in Chemistry

Abstract

Computational models in chemistry rely on a number of approximations. The effect of such approximations on observables derived from them is often unpredictable. Therefore, it is challenging to quantify the uncertainty of a computational result, which, however, is necessary to assess the suitability of a computational model. Common performance statistics such as the mean absolute error are prone to failure as they do not distinguish the explainable (systematic) part of the errors from their unexplainable (random) part. In this paper, we discuss problems and solutions for performance assessment of computational models based on several examples from the quantum chemistry literature. For this purpose, we elucidate the different sources of uncertainty, the elimination of systematic errors, and the combination of individual uncertainty components to the uncertainty of a prediction.

arXiv comment21 pages, 3 figures, 1 table

References in corpus (8)

• Towards standard methods for benchmark quality ab initio thermochemistry --- W1 and W2 theory
• W4 theory for computational thermochemistry: in pursuit of confident sub-kJ/mol predictions
• W3 theory: robust computational thermochemistry in the kJ/mol accuracy range
• Bayesian Error Estimation in Density Functional Theory
• Heuristics-Guided Exploration of Reaction Mechanisms
• Systematic Error Estimation for Chemical Reaction Energies
• A critical review of statistical calibration/prediction models handling data inconsistency and model inadequacy
• The parameters uncertainty inflation fallacy

Cited by in corpus (18)

• Exploration of Reaction Pathways and Chemical Transformation Networks
• The Exploration of Chemical Reaction Networks
• Error-Controlled Exploration of Chemical Reaction Networks with Gaussian Processes
• Calculation of Ligand Dissociation Energies in Large Transition-Metal Complexes
• Semiempirical Molecular Orbital Models based on the Neglect of Diatomic Differential Overlap Approximation
• Gaussian Process-Based Refinement of Dispersion Corrections
• Universal QM/MM Approaches for General Nanoscale Applications
• Self-Parametrizing System-Focused Atomistic Models
• Molecule-specific Uncertainty Quantification in Quantum Chemical Studies
• Statistical Analysis of Semiclassical Dispersion Corrections
• Critical Benchmarking of the G4(MP2) Model, the Correlation Consistent Composite Approach and Popular Density Functional Approximations on a Probabilistically Pruned Benchmark Dataset of Formation Enthalpies
• SCINE -- Software for Chemical Interaction Networks
• Diagnostics of Data-Driven Models: Uncertainty Quantification of PM7 Semi-Empirical Quantum Chemical Method
• Ultra-fast Spectroscopy for High-Throughput and Interactive Quantum Chemistry
• Automated Preparation of Nanoscopic Structures: Graph-Based Sequence Analysis, Mismatch Detection, and pH-Consistent Protonation with Uncertainty Estimates
• Heuristics and Uncertainty Quantification in Rational and Inverse Compound and Catalyst Design
• Phenomenological constraints on QCD transport with quantified theory uncertainties
• The Transferability Limits of Static Benchmarks