The Dark Energy Survey Image Processing Pipeline

Abstract

The Dark Energy Survey (DES) is a five-year optical imaging campaign with the goal of understanding the origin of cosmic acceleration. DES performs a 5000 square degree survey of the southern sky in five optical bands (g,r,i,z,Y) to a depth of ~24th magnitude. Contemporaneously, DES performs a deep, time-domain survey in four optical bands (g,r,i,z) over 27 square degrees. DES exposures are processed nightly with an evolving data reduction pipeline and evaluated for image quality to determine if they need to be retaken. Difference imaging and transient source detection are also performed in the time domain component nightly. On a bi-annual basis, DES exposures are reprocessed with a refined pipeline and coadded to maximize imaging depth. Here we describe the DES image processing pipeline in support of DES science, as a reference for users of archival DES data, and as a guide for future astronomical surveys.

References in corpus (29)

• Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds
• The Sloan Digital Sky Survey: Technical Summary
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• The Seventh Data Release of the Sloan Digital Sky Survey
• The USNO-B Catalog
• Gaia Data Release 1. Summary of the astrometric, photometric, and survey properties
• The Fourth US Naval Observatory CCD Astrograph Catalog (UCAC4)
• The Dark Energy Camera
• The Dark Energy Survey: more than dark energy - an overview
• The Fifth Data Release of the Sloan Digital Sky Survey
• The 10 Meter South Pole Telescope
• The Chandra Deep Field-South Survey: 4 Ms Source Catalogs
• Representations of celestial coordinates in FITS
• The Kilo-Degree Survey
• SNANA: A Public Software Package for Supernova Analysis
• Practical Weak Lensing Shear Measurement with Metacalibration
• The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
• Methods for Rapidly Processing Angular Masks of Next-Generation Galaxy Surveys
• The XMM-LSS survey. Survey design and first results
• Simultaneous Multicolor Detection of Faint Galaxies in the Hubble Deep Field
• The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey
• Automated Transient Identification in the Dark Energy Survey
• The brighter-fatter effect and pixel correlations in CCD sensors
• A scheme to deal accurately and efficiently with complex angular masks in galaxy surveys
• Forward Global Photometric Calibration of the Dark Energy Survey
• Characterization and correction of charge-induced pixel shifts in DECam
• Detection and Removal of Artifacts in Astronomical Images
• The Dark Energy Survey Data Management System
• Cyber-infrastructure to Support Science and Data Management for the Dark Energy Survey

Cited by in corpus (164)

• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• The Dark Energy Survey Data Release 1
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Modeling Uncertainty
• Dark Energy Survey Year 1 Results: Constraints on Extended Cosmological Models from Galaxy Clustering and Weak Lensing
• The Dark Energy Survey Data Release 2
• First measurement of the Hubble constant from a dark standard siren using the Dark Energy Survey galaxies and the LIGO/Virgo binary-black-hole merger GW170814
• Stellar Streams Discovered in the Dark Energy Survey
• First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters
• Dark Energy Survey Year 3 Results: Photometric Data Set for Cosmology
• Dark Energy Survey Year 3 Results: Weak Lensing Shape Catalogue
• Milky Way Satellite Census. I. The Observational Selection Function for Milky Way Satellites in DES Y3 and Pan-STARRS DR1
• KiDS+VIKING-450 and DES-Y1 combined: Mitigating baryon feedback uncertainty with COSEBIs
• First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation
• DES Y3 results: Blending shear and redshift biases in image simulations
• The Southern Stellar Stream Spectroscopic Survey ($S^5$): Overview, Target Selection, Data Reduction, Validation, and Early Science
• A statistical standard siren measurement of the Hubble constant from the LIGO/Virgo gravitational wave compact object merger GW190814 and Dark Energy Survey galaxies
• The DECam Local Volume Exploration Survey: Overview and First Data Release
• Shadows in the Dark: Low-Surface-Brightness Galaxies Discovered in the Dark Energy Survey
• Cosmological Constraints from Multiple Probes in the Dark Energy Survey
• Finding high-redshift strong lenses in DES using convolutional neural networks
• Superluminous Supernovae from the Dark Energy Survey
• Dark Energy Survey Year 1 results: Detection of Intra-cluster Light at Redshift $\sim$ 0.25
• First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: The Effect of Host Galaxy Properties on Supernova Luminosity
• Two Ultra-Faint Milky Way Stellar Systems Discovered in Early Data from the DECam Local Volume Exploration Survey
• Dark Energy Survey Year 3 results: curved-sky weak lensing mass map reconstruction
• First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Photometric Pipeline and Light Curve Data Release
• An extended halo around an ancient dwarf galaxy
• The Effect of Environment on Type Ia Supernovae in the Dark Energy Survey Three-Year Cosmological Sample
• Dark Energy Survey Year 3 Results: Point-Spread Function Modeling
• Euclid preparation: V. Predicted yield of redshift 7<z<9 quasars from the wide survey
• Dark Energy Survey Year 3 results: Cosmological constraints from galaxy clustering and galaxy-galaxy lensing using the MagLim lens sample
• Measurement of the Splashback Feature around SZ-selected Galaxy Clusters with DES, SPT and ACT
• Mitigation of LEO Satellite Brightness and Trail Effects on the Rubin Observatory LSST
• The DECam Local Volume Exploration Survey Data Release 2
• Dark Energy Survey Year 3 Results: Optimizing the Lens Sample in Combined Galaxy Clustering and Galaxy-Galaxy Lensing Analysis
• Optical Variability of Quasars with 20-Year Photometric Light Curves
• A New RASS Galaxy Cluster Catalog with Low Contamination Extending to $z\sim 1$ in the DES Overlap Region
• Dark Energy Survey Year 3 Results: Galaxy clustering and systematics treatment for lens galaxy samples
• DES Y3 cosmic shear down to small scales: constraints on cosmology and baryons
• Dark Energy Survey Year 3 Results: Measuring the Survey Transfer Function with Balrog
• The STRong lensing Insights into the Dark Energy Survey (STRIDES) 2016 follow-up campaign. I. Overview and classification of candidates selected by two techniques
• A search of the full six years of the Dark Energy Survey for outer Solar System objects
• Six More Ultra-Faint Milky Way Companions Discovered in the DECam Local Volume Exploration Survey
• Fuzzy Dark Matter and the Dark Energy Survey Year 1 Data
• Supernova Host Galaxies in the Dark Energy Survey: I. Deep Coadds, Photometry, and Stellar Masses
• Image Subtraction in Fourier Space
• The STRong lensing Insights into the Dark Energy Survey (STRIDES) 2017/2018 follow-up campaign: Discovery of 10 lensed quasars and 10 quasar pairs
• CIV Black Hole Mass Measurements with the Australian Dark Energy Survey (OzDES)
• Search for RR Lyrae stars in DES ultra-faint systems: Grus I, Kim 2, Phoenix II, and Grus II
• First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Survey Overview and Supernova Spectroscopy
• The Dark Energy Survey Year 3 and eBOSS: constraining galaxy intrinsic alignments across luminosity and colour space
• Pegasus IV: Discovery and Spectroscopic Confirmation of an Ultra-Faint Dwarf Galaxy in the Constellation Pegasus
• Discovery of an Ultra-Faint Stellar System near the Magellanic Clouds with the DECam Local Volume Exploration (DELVE) Survey
• Probing galaxy evolution in massive clusters using ACT and DES: splashback as a cosmic clock
• Dark Energy Survey Year 3 Results: Exploiting small-scale information with lensing shear ratios
• A joint SZ-Xray-optical analysis of the dynamical state of 288 massive galaxy clusters
• A Revised SALT2 Surface for Fitting Type Ia Supernova Light Curves
• Brown dwarf census with the Dark Energy Survey year 3 data and the thin disk scale height of early L types
• Constraints on the Physical Properties of GW190814 through Simulations based on DECam Follow-up Observations by the Dark Energy Survey
• Dark Energy Survey Year 3 results: Magnification modeling and impact on cosmological constraints from galaxy clustering and galaxy-galaxy lensing
• Trans-Neptunian objects found in the first four years of the Dark Energy Survey
• Perturbation theory for modeling galaxy bias: validation with simulations of the Dark Energy Survey
• H0LiCOW X: Spectroscopic/imaging survey and galaxy-group identification around the strong gravitational lens system WFI2033-4723
• The morphology and structure of stellar populations in the Fornax dwarf spheroidal galaxy from Dark Energy Survey Data
• The DES view of the Eridanus supervoid and the CMB Cold Spot
• Discovery of a Candidate Binary Supermassive Black Hole in a Periodic Quasar from Circumbinary Accretion Variability
• Mass Calibration of Optically Selected DES clusters using a Measurement of CMB-Cluster Lensing with SPTpol Data
• Dark Energy Survey Year 1 Results: Galaxy Sample for BAO Measurement
• MaxiMask and MaxiTrack: two new tools for identifying contaminants in astronomical images using convolutional neural networks
• Identifying RR Lyrae Variable Stars in Six Years of the Dark Energy Survey
• The WaZP galaxy cluster sample of the Dark Energy Survey Year 1
• A catalogue of structural and morphological measurements for DES Y1
• Measuring Cosmological Parameters with Type Ia Supernovae in redMaGiC galaxies
• Detection, Instance Segmentation, and Classification for Astronomical Surveys with Deep Learning (DeepDISC): Detectron2 Implementation and Demonstration with Hyper Suprime-Cam Data
• DES Y1 results: Splitting growth and geometry to test $\Lambda$CDM
• A unique, ring-like radio source with quadrilateral structure detected with machine learning
• WALLABY Early Science -- IV. ASKAP HI imaging of the nearby galaxy IC 5201
• The Observed Evolution of the Stellar Mass - Halo Mass Relation for Brightest Central Galaxies
• Spherical Bayesian mass-mapping with uncertainties: full sky observations on the celestial sphere
• Disentangling magnification in combined shear-clustering analyses
• Wide-Field Optical Spectroscopy of Abell 133: A Search for Filaments Reported in X-ray Observations
• Photometric Cross-Calibration of the SDSS Stripe 82 Standard Stars catalogue with Gaia EDR3, and Comparison with Pan-STARRS1, DES, CFIS and GALEX catalogues
• A faint halo star cluster discovered in the Blanco Imaging of the Southern Sky Survey
• Monte Carlo Control Loops for cosmic shear cosmology with DES Year 1
• The precious set of radio-optical reference frame objects in the light of Gaia DR2 data
• Diffuse galaxy cluster emission at 168 MHz within the Murchison Widefield Array Epoch of Reionization 0-hour field
• Rediscovery of the Sixth Star Cluster in the Fornax Dwarf Spheroidal Galaxy
• Identification of RR Lyrae stars in multiband, sparsely-sampled data from the Dark Energy Survey using template fitting and Random Forest classification
• A Deeper Look at DES Dwarf Galaxy Candidates: Grus I and Indus II
• STRIDES: Spectroscopic and photometric characterization of the environment and effects of mass along the line of sight to the gravitational lenses DES J0408-5354 and WGD 2038-4008
• Modelling the Milky Way. I -- Method and first results fitting the thick disk and halo with DES-Y3 data
• A Search for Optical Emission from Binary-Black-Hole Merger GW170814 with the Dark Energy Camera
• DELVE-ing into the Jet: a thin stellar stream on a retrograde orbit at 30 kpc
• Dark Energy Survey Year 3 results: imprints of cosmic voids and superclusters in the Planck CMB lensing map
• HI galaxies with little star formation: an abundance of LIERs
• Identification of Galaxy-Galaxy Strong Lens Candidates in the DECam Local Volume Exploration Survey Using Machine Learning
• Strategies for optimal sky subtraction in the low surface brightness regime
• Galaxy shape measurement with convolutional neural networks
• A Pride of Satellites in the Constellation Leo? Discovery of the Leo VI Milky Way Satellite Galaxy with DELVE Early Data Release 3
• Scalable precision wide-field imaging in radio interferometry: I. uSARA validated on ASKAP data
• Magnetar Models of Superluminous Supernovae from the Dark Energy Survey: Exploring Redshift Evolution
• Reducing ground-based astrometric errors with Gaia and Gaussian processes
• Using Host Galaxy Spectroscopy to Explore Systematics in the Standardisation of Type Ia Supernovae
• The DES Bright Arcs Survey: Candidate Strongly Lensed Galaxy Systems from the Dark Energy Survey 5,000 Sq. Deg. Footprint
• Optical follow-up of gravitational wave triggers with DECam during the first two LIGO/VIRGO observing runs
• Photometric Biases in Modern Surveys
• Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits
• An extended catalog of galaxy-galaxy strong gravitational lenses discovered in DES using convolutional neural networks
• ALMA CO Observations of the Host Galaxies of Long-duration Gamma-ray Bursts. I: Molecular Gas Scaling Relations
• Dark Energy Survey Year 3 Results: Redshift Calibration of the MagLim Lens Sample from the combination of SOMPZ and clustering and its impact on Cosmology
• Dark Energy Survey: Galaxy Sample for the Baryonic Acoustic Oscillation Measurement from the Final Dataset
• The PSZ-MCMF catalogue of Planck clusters over the DES region
• Group pre-processing versus cluster ram-pressure stripping: the case of ESO156-G029
• The Karl G. Jansky Very Large Array Local Group L-band Survey (LGLBS)
• The Dark Energy Survey Supernova Program: Corrections on photometry due to wavelength-dependent atmospheric effects
• Noise from Undetected Sources in Dark Energy Survey Images
• Shedding Light on Low Surface Brightness Galaxies in Dark Energy Survey with Transformers
• Astrometry and Occultation predictions to Trans-Neptunian and Centaur Objects observed within the Dark Energy Survey
• Dark Energy Survey Year 6 Results: Cell-based Coadds and Metadetection Weak Lensing Shape Catalogue
• Signature of a massive rotating metal-poor star imprinted in the Phoenix stellar stream
• Proposed method of combining continuum mechanics with Einstein Field Equations
• Observation and Confirmation of Nine Strong Lensing Systems in Dark Energy Survey Year 1 Data
• Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample
• Dark Energy Survey Year 1: An independent E/B-mode cosmic shear analysis
• Fast Forward Modelling of Galaxy Spatial and Statistical Distributions
• Constraining Radio Mode Feedback in Galaxy Clusters with the Cluster Radio AGN Properties to z$\sim$1
• Euclid preparation. Observational expectations for redshift z<7 active galactic nuclei in the Euclid Wide and Deep surveys
• Optical constraints on the coldest metal-poor population
• Optical Properties of Metal-poor T Dwarf Candidates
• Very Large Array imaging rules out precessing radio jets in three DES$-$SDSS-selected candidate periodic quasars
• Clash of Titans: The Impact of Cluster Mergers in the Galaxy Cluster Red Sequence
• Galaxy-galaxy lensing in the VOICE deep survey
• Clash of Titans: a MUSE dynamical study of the extreme cluster merger SPT-CL J0307-6225
• Relatively young thick disks in star-forming late-type galaxies
• DES to HSC: Detecting low surface brightness galaxies in the Abell 194 cluster using transfer learning
• DELVE-DEEP Survey: The Faint Satellite System of NGC 55
• Dark Energy Survey Year 3 Results: Deep Field Optical + Near-Infrared Images and Catalogue
• Detection of an orthogonal alignment between parsec scale AGN jets and their host galaxies
• Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning
• The Environment of Lyman Break Analogues (ELBA) survey: Star-forming galaxies in small groups
• Ultra-Faint Milky Way Satellites Discovered in Carina, Phoenix, and Telescopium with DELVE Data Release 3
• The mass and galaxy distribution around SZ-selected clusters
• Narrow absorption lines from intervening material in supernovae. II. Galaxy properties
• Color Transformations of Photometric Measurements of Galaxies in Optical and Near-Infrared Wide-Field Imaging Surveys
• Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis
• Dark Energy Survey Year 6 Results: Intra-Cluster Light from Redshift 0.2 to 0.5
• OzDES Reverberation Mapping Program: Stacking analysis with H$\beta$, Mg II and C IV
• DELVE Milky Way Satellite Galaxy Census I: Satellite Population and Survey Selection Function in DES, DELVE, and Pan-STARRS
• DELVE-ing into the Milky Way's Globular Clusters: Assessing extra-tidal features in NGC 5897, NGC 7492, and testing detectability with deeper photometry
• Eridanus IV: an Ultra-Faint Dwarf Galaxy Candidate Discovered in the DECam Local Volume Exploration Survey
• Power Suppression and Lensing Anomaly -- A phenomenological investigation
• Dark Energy Survey Year 3 Results: Galaxy Sample for BAO Measurement
• Dark Energy Survey Year 3 results: Cosmology with peaks using an emulator approach
• From the Fire: A Deeper Look at the Phoenix Stream
• Magellan/IMACS spectroscopy of Grus I: A low metallicity ultra-faint dwarf galaxy
• Full-frame data reduction method: a data mining tool to detect the potential variations in optical photometry
• A DESGW Search for the Electromagnetic Counterpart to the LIGO/Virgo Gravitational Wave Binary Neutron Star Merger Candidate S190510g
• A VLA Survey of Late-time Radio Emission from Superluminous Supernovae and the Host Galaxies
• Low-frequency integrated radio spectra of diffuse, steep-spectrum sources in galaxy clusters: palaeontology with the MWA and ASKAP
• The Local Galactic Transient Survey Applied to an Optical Search for Directed Intelligence
• The influence of the Cosmic Web on the properties of dwarf galaxies in the Fornax-Eridanus Supercluster
• Multi-wavelength Optical and NIR Variability Analysis of the Blazar PKS 0027-426
• RR Lyrae stars in the newly discovered ultra-faint dwarf galaxy Centaurus I