21st Century Statistical and Computational Challenges in Astrophysics

Abstract

Modern astronomy has been rapidly increasing our ability to see deeper into the universe, acquiring enormous samples of cosmic populations. Gaining astrophysical insights from these datasets requires a wide range of sophisticated statistical and machine learning methods. Long-standing problems in cosmology include characterization of galaxy clustering and estimation of galaxy distances from photometric colors. Bayesian inference, central to linking astronomical data to nonlinear astrophysical models, addresses problems in solar physics, properties of star clusters, and exoplanet systems. Likelihood-free methods are growing in importance. Detection of faint signals in complicated noise is needed to find periodic behaviors in stars and detect explosive gravitational wave events. Open issues concern treatment of heteroscedastic measurement errors and understanding probability distributions characterizing astrophysical systems. The field of astrostatistics needs increased collaboration with statisticians in the design and analysis stages of research projects, and to jointly develop new statistical methodologies. Together, they will draw more astrophysical insights into astronomical populations and the cosmos itself.

arXiv commentAccepted for publication in volume 8 of Annual Reviews of Statistics and Its Application. 26 pages, 7 figures

References in corpus (85)

• Simulating the joint evolution of quasars, galaxies and their large-scale distribution
• Detection of the Baryon Acoustic Peak in the Large-Scale Correlation Function of SDSS Luminous Red Galaxies
• Multi-messenger Observations of a Binary Neutron Star Merger
• A Relationship Between Nuclear Black Hole Mass and Galaxy Velocity Dispersion
• Understanding the Lomb-Scargle Periodogram
• Bayesian photometric redshift estimation
• A box-fitting algorithm in the search for periodic transits
• Rotation-invariant convolutional neural networks for galaxy morphology prediction
• The NANOGrav 11-year Data Set: High-precision timing of 45 Millisecond Pulsars
• The Illustris Simulation: Public Data Release
• Quantifying the Uncertainty in the Orbits of Extrasolar Planets
• Assessing statistical significance of periodogram peaks
• Improving galaxy morphologies for SDSS with Deep Learning
• Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
• A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation
• A Cosmic Watershed: the WVF Void Detection Technique
• Filamentary structures and compact objects in the Aquila and Polaris clouds observed by Herschel
• Age determination for 269 $Gaia$ DR2 Open Clusters
• Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy
• Generative Adversarial Networks recover features in astrophysical images of galaxies beyond the deconvolution limit
• The NANOGrav Nine-year Data Set: Observations, Arrival Time Measurements, and Analysis of 37 Millisecond Pulsars
• CMU DeepLens: Deep Learning For Automatic Image-based Galaxy-Galaxy Strong Lens Finding
• Photometric redshifts from SDSS images using a Convolutional Neural Network
• Photometric redshifts for the SDSS Data Release 12
• The Local Nanohertz Gravitational-Wave Landscape From Supermassive Black Hole Binaries
• Shapefinders: A new shape diagnostic for large scale structure
• Photometric redshift estimation via deep learning
• COLDz: Shape of the CO Luminosity Function at High Redshift and the Cold Gas History of the Universe
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• BGLS: A Bayesian formalism for the generalised Lomb-Scargle periodogram
• On the function describing the stellar initial mass function
• Skeleton as a probe of the cosmic web: the 2D case
• Blip glitches in Advanced LIGO data
• Crawling the Cosmic Network: Identifying and Quantifying Filamentary Structure
• New advances in the Gaussian-process approach to pulsar-timing data analysis
• Gaia DR2 unravels incompleteness of nearby cluster population: New open clusters in the direction of Perseus
• Nuisance hardened data compression for fast likelihood-free inference
• Variability Timescale and Spectral Index of Sgr A* in the Near Infrared: Approximate Bayesian Computation Analysis of the Variability of the Closest Supermassive Black Hole
• Approximate Bayesian Computation for Astronomical Model Analysis: A Case Study in Galaxy Demographics and Morphological Transformation at High Redshift
• Automatic physical inference with information maximising neural networks
• Likelihood-Free Cosmological Inference with Type Ia Supernovae: Approximate Bayesian Computation for a Complete Treatment of Uncertainty
• OzDES multifibre spectroscopy for the Dark Energy Survey: Three year results and first data release
• Generalized massive optimal data compression
• Are we there yet? Time to detection of nanohertz gravitational waves based on pulsar-timing array limits
• SCARLET: Source separation in multi-band images by Constrained Matrix Factorization
• Wasserstein Dictionary Learning: Optimal Transport-based unsupervised non-linear dictionary learning
• Approximate Bayesian Computation for Forward Modeling in Cosmology
• Discovery of a Third Transiting Planet in the Kepler-47 Circumbinary System
• Deep Learning Identifies High-z Galaxies in a Central Blue Nugget Phase in a Characteristic Mass Range
• Large-scale mass distribution in the Illustris simulation
• Evidence for Quasi-isotropic Magnetic Fields from Hinode Quiet Sun Observations
• cosmoabc: Likelihood-free inference via Population Monte Carlo Approximate Bayesian Computation
• Improving the Accuracy of Planet Occurrence Rates from Kepler using Approximate Bayesian Computation
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• A new model to predict weak-lensing peak counts II. Parameter constraint strategies
• A blind test of photometric redshifts on ground-based data
• Filaments in observed and mock galaxy catalogues
• Cosmic Web Reconstruction through Density Ridges: Method and Algorithm
• On the realistic validation of photometric redshifts, or why Teddy will never be Happy
• astroABC: An Approximate Bayesian Computation Sequential Monte Carlo sampler for cosmological parameter estimation
• Photometry of high-redshift blended galaxies using deep learning
• Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
• A New Method to Measure the Post-Reionization Ionizing Background from the Joint Distribution of Lyman-$\alpha$ and Lyman-$\beta$ Forest Transmission
• Deblending galaxy superpositions with branched generative adversarial networks
• Star Formation Quenching Timescale of Central Galaxies in a Hierarchical Universe
• STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
• The Overlooked Potential of Generalized Linear Models in Astronomy - I: Binomial Regression
• Efficient modeling of correlated noise I. Statistical significance of periodogram peaks
• A Unified Framework for Photometric Redshifts
• Statistical analysis of stellar evolution
• The Overlooked Potential of Generalized Linear Models in Astronomy-III: Bayesian Negative Binomial Regression and Globular Cluster Populations
• Filaments and striations: anisotropies in observed, supersonic, highly-magnetised turbulent clouds
• The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
• AutoRegressive Planet Search: Methodology
• A comparative study of four significance measures for periodicity detection in astronomical surveys
• Accelerating Approximate Bayesian Computation with Quantile Regression: Application to Cosmological Redshift Distributions
• Data Quality Studies of Enhanced Interferometric Gravitational Wave Detectors
• PyGFit: A Tool for Extracting PSF Matched Photometry
• The Minimum Description Length Principle and Model Selection in Spectropolarimetry
• Morpho-Photometric Redshifts
• A Preferential Attachment Model for the Stellar Initial Mass Function
• Ridges in the Dark Energy Survey for cosmic trough identification
• A Bootstrap Method for Sinusoid Detection in Colored Noise and Uneven Sampling. Application to Exoplanet Detection
• Simulation-based marginal likelihood for cluster strong lensing cosmology
• Probability density estimation of photometric redshifts based on machine learning

Cited by in corpus (13)

• Fast and robust Bayesian Inference using Gaussian Processes with GPry
• Incorporating Measurement Error in Astronomical Object Classification
• Long gamma-ray burst light curves as the result of a common stochastic pulse-avalanche process
• Machine learning applications for the study of AGN physical properties using photometric observations
• Machine learning applications in astrophysics: Photometric redshift estimation
• An approach to robust Bayesian regression in astronomy
• Six Maxims of Statistical Acumen for Astronomical Data Analysis
• A Statistical Primer on Classical Period-Finding Techniques in Astronomy
• Many-probes multi-object spatially-resolved analyses of galaxy clusters in the big data era
• Identifying Radio Active Galactic Nuclei with Machine Learning and Large-Area Surveys
• OGLE-IV Period-Luminosity relation of the LMC: an analysis using mean and median magnitudes
• A Serverless Architecture for Efficient and Scalable Monte Carlo Markov Chain Computation
• UV bright red-sequence galaxies: a comparative study between UV upturn and UV weak systems