Six Maxims of Statistical Acumen for Astronomical Data Analysis
arXiv:2408.16179 · doi:10.3847/1538-4365/ad8440
Abstract
The production of complex astronomical data is accelerating, especially with newer telescopes producing ever more large-scale surveys. The increased quantity, complexity, and variety of astronomical data demand a parallel increase in skill and sophistication in developing, deciding, and deploying statistical methods. Understanding limitations and appreciating nuances in statistical and machine learning methods and the reasoning behind them is essential for improving data-analytic proficiency and acumen. Aiming to facilitate such improvement in astronomy, we delineate cautionary tales in statistics via six maxims, with examples drawn from the astronomical literature. Inspired by the significant quality improvement in business and manufacturing processes by the routine adoption of Six Sigma, we hope the routine reflection on these Six Maxims will improve the quality of both data analysis and scientific findings in astronomy.
References in corpus (57)
- Observation of Gravitational Waves from a Binary Black Hole Merger
- Planck 2015 results. XIII. Cosmological parameters
- A 2.4% Determination of the Local Value of the Hubble Constant
- Some Aspects of Measurement Error in Linear Regression of Astronomical Data
- Tensions between the Early and the Late Universe
- Are the Variations in Quasar Optical Flux Driven by Thermal Fluctuations?
- Detection of An Unidentified Emission Line in the Stacked X-ray spectrum of Galaxy Clusters
- Cosmic Distances Calibrated to 1% Precision with Gaia EDR3 Parallaxes and Hubble Space Telescope Photometry of 75 Milky Way Cepheids Confirm Tension with LambdaCDM
- Modeling the Time Variability of SDSS Stripe 82 Quasars as a Damped Random Walk
- Statistics: Handle with Care, Detecting Multiple Model Components with the Likelihood Ratio Test
- A Wavelet-Based Algorithm for the Spatial Analysis of Poisson Data
- The Chandra Source Catalog
- Second ROSAT all-sky survey (2RXS) source catalogue
- The prior can generally only be understood in the context of the likelihood
- Quantifying Quasar Variability As Part of a General Approach To Classifying Continuously Varying Sources
- Is Quasar Optical Variability a Damped Random Walk?
- Flexible and Scalable Methods for Quantifying Stochastic Variability in the Era of Massive Time-Domain Astronomical Data Sets
- Kepler Observations of Rapid Optical Variability in Active Galactic Nuclei
- On the use of C-stat in testing models for X-ray spectra
- Think Outside the Color Box: Probabilistic Target Selection and the SDSS-XDQSO Quasar Targeting Catalog
- A Compton-thick Wind in the High Luminosity Quasar, PDS 456
- Clarifying the Hubble constant tension with a Bayesian hierarchical model of the local distance ladder
- COSMOGRAIL: the COSmological MOnitoring of GRAvItational Lenses XIII: Time delays and 9-yr optical monitoring of the lensed quasar RX J1131-1231
- Are the Variability Properties of the Kepler AGN Light Curves Consistent with a Damped Random Walk?
- Probabilistic Cross-Identification of Astronomical Sources
- The Carnegie-Chicago Hubble Program. I. An Independent Approach to the Extragalactic Distance Scale Using only Population II Distance Indicators
- Chi-square and Poissonian Data: Biases Even in the High-Count Regime and How to Avoid them
- Dust SEDs in the era of Herschel and Planck: a Hierarchical Bayesian fitting technique
- A novel variability-based method for quasar selection: evidence for a rest frame ~54 day characteristic timescale
- No evidence of phosphine in the atmosphere of Venus by independent analyses
- The Thermal Properties of Solar Flares Over Three Solar Cycles Using GOES X-ray Observations
- On Computing Upper Limits to Source Intensities
- The Type Ia Supernova Color-Magnitude Relation and Host Galaxy Dust: A Simple Hierarchical Bayesian Model
- AGN Variability Analysis Handbook
- Examining AGN UV/optical Variability Beyond the Simple Damped Random Walk
- Assessment of stochastic and deterministic models of 6304 quasar lightcurves from SDSS Stripe 82
- Gravitational-wave astronomy with a physical calibration model
- A Degeneracy in DRW Modelling of AGN Light Curves
- STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
- Accounting for Calibration Uncertainties in X-ray Analysis: Effective Areas in Spectral Fitting
- Absolute Calibration of the Radio Astronomy Flux Density Scale at 22 to 43 GHz Using Planck
- New two-colour light curves of Q0957+561: time delays and the origin of intrinsic variations
- A Repelling-Attracting Metropolis Algorithm for Multimodality
- A Refined QSO Selection Method Using Diagnostics Tests: 663 QSO Candidates in the LMC
- AutoRegressive Planet Search: Methodology
- Improved Point Source Detection in Crowded Fields using Probabilistic Cataloging
- Modeling Stochastic Variability in Multi-Band Time Series Data
- How proper are Bayesian models in the astronomical literature?
- Bayesian Estimates of Astronomical Time Delays between Gravitationally Lensed Stochastic Light Curves
- 21st Century Statistical and Computational Challenges in Astrophysics
- Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: I. The optimal statistic
- Robust and Accurate Inference via a Mixture of Gaussian and Student's t Errors
- Eddington-Malmquist bias in a cosmological context
- TD-CARMA: Painless, accurate, and scalable estimates of gravitational-lens time delays with flexible CARMA processes
- Rgbp: An R Package for Gaussian, Poisson, and Binomial Random Effects Models with Frequency Coverage Evaluations
- Stratified Learning: A General-Purpose Statistical Method for Improved Learning under Covariate Shift
- Controlling Outlier Contamination In Multimessenger Time-domain Searches For Supermasssive Binary Black Holes