The Dark Energy Survey Data Processing and Calibration System
arXiv:1207.3189 · doi:10.1117/12.926785
Abstract
The Dark Energy Survey (DES) is a 5000 deg2 grizY survey reaching characteristic photometric depths of 24th magnitude (10 sigma) and enabling accurate photometry and morphology of objects ten times fainter than in SDSS. Preparations for DES have included building a dedicated 3 deg2 CCD camera (DECam), upgrading the existing CTIO Blanco 4m telescope and developing a new high performance computing (HPC) enabled data management system (DESDM). The DESDM system will be used for processing, calibrating and serving the DES data. The total data volumes are high (~2PB), and so considerable effort has gone into designing an automated processing and quality control system. Special purpose image detrending and photometric calibration codes have been developed to meet the data quality requirements, while survey astrometric calibration, coaddition and cataloging rely on new extensions of the AstrOmatic codes which now include tools for PSF modeling, PSF homogenization, PSF corrected model fitting cataloging and joint model fitting across multiple input images. The DESDM system has been deployed on dedicated development clusters and HPC systems in the US and Germany. An extensive program of testing with small rapid turn-around and larger campaign simulated datasets has been carried out. The system has also been tested on large real datasets, including Blanco Cosmology Survey data from the Mosaic2 camera. In Fall 2012 the DESDM system will be used for DECam commissioning, and, thereafter, the system will go into full science operations.
12 pages, submitted for publication in SPIE Proceeding 8451-12
References in corpus (2)
Cited by in corpus (57)
- Eight New Milky Way Companions Discovered in First-Year Dark Energy Survey Data
- Eight Ultra-faint Galaxy Candidates Discovered in Year Two of the Dark Energy Survey
- The Dark Energy Survey Data Release 1
- The Dark Energy Survey Data Release 2
- The DES Science Verification Weak Lensing Shear Catalogues
- Stellar Kinematics and Metallicities in the Ultra-Faint Dwarf Galaxy Reticulum II
- Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
- Horologium II: a Second Ultra-faint Milky Way Satellite in the Horologium Constellation
- Superluminous Supernovae from the Dark Energy Survey
- An Ultra-Faint Galaxy Candidate Discovered in Early Data from the Magellanic Satellites Survey
- Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data
- Dynamical Analysis of Nearby ClustErs. Automated astrometry from the ground: precision proper motions over wide field
- Characterization and correction of charge-induced pixel shifts in DECam
- VDES J2325-5229 a z=2.7 gravitationally lensed quasar discovered using morphology independent supervised machine learning
- Mass and galaxy distributions of four massive galaxy clusters from Dark Energy Survey Science Verification data
- Star/galaxy separation at faint magnitudes: Application to a simulated Dark Energy Survey
- A Dark Energy Camera Search for an Optical Counterpart to the First Advanced LIGO Gravitational Wave Event GW150914
- Mapping and simulating systematics due to spatially-varying observing conditions in DES Science Verification data
- Galaxy-Galaxy Lensing in the DES Science Verification Data
- Joint Measurement of Lensing-Galaxy Correlations Using SPT and DES SV Data
- Cross-correlation of gravitational lensing from DES Science Verification data with SPT and Planck lensing
- Supernova Host Galaxies in the Dark Energy Survey: I. Deep Coadds, Photometry, and Stellar Masses
- The Phoenix stream: a cold stream in the Southern hemisphere
- Galaxies in X-ray Selected Clusters and Groups in Dark Energy Survey Data I: Stellar Mass Growth of Bright Central Galaxies Since z~1.2
- Modelling the Transfer Function for the Dark Energy Survey
- CLASH-VLT: Abell~S1063. Cluster assembly history and spectroscopic catalogue
- The Evolution of Active Galactic Nuclei in Clusters of Galaxies from the Dark Energy Survey
- A Search for Kilonovae in the Dark Energy Survey
- Instrumental response model and detrending for the Dark Energy Camera
- Discovery of a Stellar Overdensity in Eridanus-Phoenix in the Dark Energy Survey
- Combining Dark Energy Survey Science Verification Data with Near Infrared Data from the ESO VISTA Hemisphere Survey
- Weak lensing magnification in the Dark Energy Survey Science Verification Data
- A catalogue of structural and morphological measurements for DES Y1
- I. Apples to apples : realistic galaxy simulated catalogs and photometric redshift predictions for next-generation surveys
- A Study of Quasar Selection in the Dark Energy Survey Supernova fields
- Galaxy bias from the Dark Energy Survey Science Verification data: combining galaxy density maps and weak lensing maps
- Core or cusps: The central dark matter profile of a redshift one strong lensing cluster with a bright central image
- A Dark Energy Camera Search for Missing Supergiants in the LMC After the Advanced LIGO Gravitational Wave Event GW150914
- DES Science Portal: Computing Photometric Redshifts
- Super-resolution method using sparse regularization for point-spread function recovery
- Deep SOAR follow-up photometry of two Milky Way outer-halo companions discovered with Dark Energy Survey
- Optical-SZE Scaling Relations for DES Optically Selected Clusters within the SPT-SZ Survey
- Comparing Dark Energy Survey and HST-CLASH observations of the galaxy cluster RXC J2248.7-4431: implications for stellar mass versus dark matter
- Morphological Star-Galaxy Separation
- The Clusters Hiding in Plain Sight (CHiPS) survey: Complete sample of extreme BCG clusters
- A collimated beam projector for precise telescope calibration
- A DECam Search for Explosive Optical Transients Associated with IceCube Neutrinos
- The DES Bright Arcs Survey: Candidate Strongly Lensed Galaxy Systems from the Dark Energy Survey 5,000 Sq. Deg. Footprint
- CosmoDM and its application to Pan-STARRS data
- Supporting High-Performance and High-Throughput Computing for Experimental Science
- On the density profile of the globular cluster M92
- DES Science Portal: Creating Science-Ready Catalogs
- Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning
- Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
- The Dark Energy Survey view of the Sagittarius stream: discovery of two faint stellar system candidates
- Modern Python at the Large Synoptic Survey Telescope
- SOAR/Goodman Spectroscopic Assessment of Candidate Counterparts of the LIGO-Virgo Event GW190814