Getting the model right; an information criterion for spectroscopy

Abstract

Robust model-fitting to spectroscopic transitions is a requirement across many fields of science. The corrected Akaike and Bayesian information criteria (AICc and BIC) are most frequently used to select the optimal number of fitting parameters. In general, AICc modelling is thought to overfit (too many model parameters) and BIC underfits. For spectroscopic modelling, both AICc and BIC lack in two important respects: (a) no penalty distinction is made according to line strength such that parameters of weak lines close to the detection threshold are treated with equal importance as strong lines and (b) no account is taken of the way in which spectral lines impact on narrow data regions. In this paper we introduce a new information criterion that addresses these shortcomings, the "Spectral Information Criterion" (SpIC). Spectral simulations are used to compare performances. The main findings are (i) SpIC clearly outperforms AICc for high signal to noise data, (ii) SpIC and AICc work equally well for lower signal to noise data, although SpIC achieves this with fewer parameters, and (iii) BIC does not perform well (for this application) and should be avoided. The new method should be of broader applicability (beyond spectroscopy), wherever different model parameters influence separated small ranges within a larger dataset and/or have widely varying sensitivities.

arXiv comment13 pages, 7 figures

References in corpus (7)

• Astrophysics Source Code Library
• Information criteria for astrophysical model selection
• High-precision limit on variation in the fine-structure constant from a single quasar absorption system
• Artificial intelligence applied to the automatic analysis of absorption spectra. Objective measurement of the fine structure constant
• A new era of fine structure constant measurements at high redshift
• Artificial intelligence and quasar absorption system modelling; application to fundamental constants at high redshift
• Evaluating the New Automatic Method for the Analysis of Absorption Spectra Using Synthetic Spectra

Cited by in corpus (10)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
• Non-uniqueness in quasar absorption models and implications for measurements of the fine structure constant
• Artificial intelligence and quasar absorption system modelling; application to fundamental constants at high redshift
• Evidence for extended gaseous reservoirs around AGN at cosmic noon from ALMA CO(3-2) observations
• Precision in high resolution absorption line modelling, analytic Voigt derivatives, and optimisation methods
• Varying alpha, blinding, and bias in existing measurements
• The Mystery of Alpha and the Isotopes
• Nature-inspired optimization, the Philippine Eagle, and cosmological parameter estimation
• Genetic algorithm demystified for cosmological parameter estimation