Planck 2018 results. III. High Frequency Instrument data processing and frequency maps

Abstract

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous 2015 release. They enabled the first significant measurement of the reionization optical depth parameter using HFI data. This paper presents an extensive analysis of systematic effects, including the use of simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved. Calibration, based on the CMB dipole, is now extremely accurate and in the frequency range 100 to 353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than $0.35\mu$K, an accuracy of order $10^{-4}$. This is a major legacy from the HFI for future CMB experiments. The removal of bandpass leakage has been improved by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. Simulations reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect. Using these simulations, we measure and correct the small frequency calibration bias induced by this systematic effect at the $10^{-4}$ level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the $10^{-3}$ level.

Accepted for publication on A&A (AA/2018/32909)

References in corpus (57)

• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Planck 2018 results. X. Constraints on inflation
• The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
• The Milky Way in Molecular Clouds: A New Complete CO Survey
• Toward a halo mass function for precision cosmology: the limits of universality
• Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Data Processing, Sky Maps, and Basic Results
• Planck 2018 results. I. Overview and the cosmological legacy of Planck
• An analytic model for the spatial clustering of dark matter haloes
• The Temperature of the Cosmic Microwave Background
• Planck 2018 results. V. CMB power spectra and likelihoods
• The universal galaxy cluster pressure profile from a representative sample of nearby systems (REXCESS) and the Y_SZ-M_500 relation
• Planck 2013 results. XI. All-sky model of thermal dust emission
• Planck 2018 results. VIII. Gravitational lensing
• The Spectrum of the Extragalactic Far Infrared Background from the COBE Firas Observations
• Planck 2015 results. XI. CMB power spectra, likelihoods, and robustness of parameters
• Planck 2013 results. XV. CMB power spectra and likelihood
• Calibrator Design for the COBE Far Infrared Absolute Spectrophotometer (FIRAS)
• The COBE Diffuse Infrared Background Experiment Search for the Cosmic Infrared Background: II. Model of the Interplanetary Dust Cloud
• Planck 2018 results. VII. Isotropy and Statistics of the CMB
• Large-Scale Structure of the Molecular Gas in Taurus Revealed by High Linear Dynamic Range Spectral Line Mapping
• Planck 2018 results. IV. Diffuse component separation
• Planck intermediate results. XLVI. Reduction of large-scale systematic effects in HFI polarization maps and estimation of the reionization optical depth
• Planck 2018 results. III. High Frequency Instrument data processing and frequency maps
• Planck 2013 results. XXX. Cosmic infrared background measurements and implications for star formation
• Planck 2015 results. X. Diffuse component separation: Foreground maps
• Planck 2015 results. VIII. High Frequency Instrument data processing: Calibration and maps
• The pre-launch Planck Sky Model: a model of sky emission at submillimetre to centimetre wavelengths
• A unified empirical model for infrared galaxy counts based on observed physical evolution of distant galaxies
• Planck 2013 results. XIII. Galactic CO emission
• The Scientific Programme of Planck
• Separation of anomalous and synchrotron emissions using WMAP polarization data
• Planck 2018 results. XI. Polarized dust foregrounds
• Planck 2018 results. XII. Galactic astrophysics using polarized dust emission
• Planck intermediate results. XXII. Frequency dependence of thermal emission from Galactic dust in intensity and polarization
• Planck early results: first assessment of the High Frequency Instrument in-flight performance
• Modeling the evolution of infrared galaxies: A Parametric backwards evolution model
• Foreground component separation with generalised ILC
• The CLASSgal code for Relativistic Cosmological Large Scale Structure
• Xspect, estimation of the angular power spectrum by computing cross-power spectra with analytical error bars
• Planck 2015 results. XXVI. The Second Planck Catalogue of Compact Sources
• Planck 2013 results. VIII. HFI photometric calibration and mapmaking
• A hybrid model for the evolution of galaxies and Active Galactic Nuclei in the infrared
• Planck 2013 results. VI. High Frequency Instrument data processing
• Planck 2013 results. XIV. Zodiacal emission
• Planck pre-launch status: High Frequency Instrument polarization calibration
• Planck 2013 results. VII. HFI time response and beams
• Relativistic Corrections to the Sunyaev-Zel'dovich Effect for Clusters of Galaxies. II. Inclusion of Peculiar Velocities
• Planck 2018 results. II. Low Frequency Instrument data processing
• Planck 2013 results X. Energetic particle effects: characterization, removal, and simulation
• Planck 2013 results. XXXI. Consistency of the Planck data
• Planck 2015 results. XII. Full Focal Plane simulations
• Planck 2015 results. VII. HFI TOI and beam processing
• A simulation pipeline for the Planck mission
• Planck intermediate results. XLVIII. Disentangling Galactic dust emission and cosmic infrared background anisotropies
• Making sky maps from Planck data
• A maximum likelihood approach to the destriping technique
• Planck intermediate results. LII. Planet flux densities

Cited by in corpus (217)

• Planck 2018 results. X. Constraints on inflation
• The Simons Observatory: Science goals and forecasts
• Planck 2018 results. V. CMB power spectra and likelihoods
• Challenges for $\Lambda$CDM: An update
• Planck 2018 results. VIII. Gravitational lensing
• Planck 2018 results. VII. Isotropy and Statistics of the CMB
• Planck 2018 results. IV. Diffuse component separation
• Planck 2018 results. III. High Frequency Instrument data processing and frequency maps
• Planck intermediate results. LVII. Joint Planck LFI and HFI data processing
• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• New Extraction of the Cosmic Birefringence from the Planck 2018 Polarization Data
• The Atacama Cosmology Telescope: A Measurement of the DR6 CMB Lensing Power Spectrum and its Implications for Structure Growth
• On the evolution of the Hubble constant with the SNe Ia Pantheon Sample and Baryon Acoustic Oscillations: a feasibility study for GRB-cosmology in 2030
• CMB power spectra and cosmological parameters from Planck PR4 with CamSpec
• Planck 2018 results. VI. Cosmological parameters
• Planck 2018 results. XI. Polarized dust foregrounds
• Cosmological parameters derived from the final (PR4) Planck data release
• Planck 2018 results. XII. Galactic astrophysics using polarized dust emission
• New physics from the polarised light of the cosmic microwave background
• Cosmic Birefringence from Planck Data Release 4
• Planck constraints on the tensor-to-scalar ratio
• From galactic bars to the Hubble tension: weighing up the astrophysical evidence for Milgromian gravity
• Improved Constraints on Cosmic Birefringence from the WMAP and Planck Cosmic Microwave Background Polarization Data
• Cosmological implications of the anisotropy of ten galaxy cluster scaling relations
• Gaia Early Data Release 3: Acceleration of the solar system from Gaia astrometry
• Reionization optical depth determination from Planck HFI data with ten percent accuracy
• Modeling the magnetized Local Bubble from dust data
• Cosmological constraints on post-Newtonian parameters in effectively massless scalar-tensor theories of gravity
• The Gamma-Ray Window to Intergalactic Magnetism
• Cosmology From CMB Lensing and Delensed EE Power Spectra Using 2019-2020 SPT-3G Polarization Data
• The Origin of Parity Violation in Polarized Dust Emission and Implications for Cosmic Birefringence
• SRoll2: an improved mapmaking approach to reduce large-scale systematic effects in the Planck High Frequency Instrument legacy maps
• CMB/kSZ and Compton-$y$ Maps from 2500 square degrees of SPT-SZ and Planck Survey Data
• Cosmological parameter inference with Bayesian statistics
• Testing the Cosmological Principle with CatWISE Quasars: A Bayesian Analysis of the Number-Count Dipole
• CMB spectral distortions revisited: a new take on $\mu$ distortions and primordial non-Gaussianities from FIRAS data
• Inference of the optical depth to reionization from low multipole temperature and polarisation Planck data
• QUIJOTE scientific results -- IV. A northern sky survey in intensity and polarization at 10-20GHz with the Multi-Frequency Instrument
• Evidence for Line-of-Sight Frequency Decorrelation of Polarized Dust Emission in $Planck$ Data
• Full-sky Cosmic Microwave Background Foreground Cleaning Using Machine Learning
• A Demonstration of Improved Constraints on Primordial Gravitational Waves with Delensing
• Absolute calibration of the polarisation angle for future CMB $B$-mode experiments from current and future measurements of the Crab nebula
• The metal content of the hot atmospheres of galaxy groups
• The geometry of the magnetic field in the Central Molecular Zone measured by PILOT
• The Atacama Cosmology Telescope DR6 and DESI: Structure formation over cosmic time with a measurement of the cross-correlation of CMB Lensing and Luminous Red Galaxies
• Planck 2018 constraints on anisotropic birefringence and its cross-correlation with CMB anisotropy
• Revealing Gravitational Collapse in Serpens G3-G6 Molecular Cloud using Velocity Gradients
• Direct detection of the kinetic Sunyaev-Zel'dovich effect in galaxy clusters
• The Atacama Cosmology Telescope: Microwave Intensity and Polarization Maps of the Galactic Center
• Cosmic Inflation at the Crossroads
• Planck intermediate results. LVI. Detection of the CMB dipole through modulation of the thermal Sunyaev-Zeldovich effect: Eppur si muove II
• Planck constraints on cross-correlations between anisotropic cosmic birefringence and CMB polarization
• Polycyclic Aromatic Hydrocarbons, the Anomalous Microwave Emission, and Their Connection to the Cold Neutral Medium
• Bayesian estimation of our local motion from the Planck-2018 CMB temperature map
• Probing cosmic birefringence with polarized Sunyaev-Zel'dovich tomography
• Foreground Separation and Constraints on Primordial Gravitational Waves with the PICO Space Mission
• Multi-scale Magnetic Fields in the Central Molecular Zone: Inference from the Gradient Technique
• A new approach for the statistical denoising of Planck interstellar dust polarization data
• BeyondPlanck I. Global Bayesian analysis of the Planck Low Frequency Instrument data
• Probing Lorentz-violating electrodynamics with CMB polarization
• How the Big Bang Ends up Inside a Black Hole
• Cross-correlation of DES Y3 lensing and ACT/$Planck$ thermal Sunyaev Zel'dovich Effect I: Measurements, systematics tests, and feedback model constraints
• Observational Constraints on Dynamical Dark Energy Models
• The Integrated Sachs Wolfe effect: unWISE and Planck constraints on Dynamical Dark Energy
• NIKA 150 GHz polarization observations of the Crab nebula and its spectral energy distribution
• BeyondPlanck XIII. Intensity foreground sampling, degeneracies, and priors
• Probing Interstellar Grain Growth Through Polarimetry in the Taurus Cloud Complex
• Taking measurements of the kinematic Sunyaev-Zel'dovich effect forward: including uncertainties from velocity reconstruction with forward modeling
• Full-sky Models of Galactic Microwave Emission and Polarization at Sub-arcminute Scales for the Python Sky Model
• Magnetic Misalignment of Interstellar Dust Filaments
• Joint analysis of DES Year 3 data and CMB lensing from SPT and Planck I: Construction of CMB Lensing Maps and Modeling Choices
• Cosmological constraints from the cross-correlation of DESI Luminous Red Galaxies with CMB lensing from Planck PR4 and ACT DR6
• Non-Gaussian modelling and statistical denoising of Planck dust polarization full-sky maps using scattering transforms
• The multiphase and magnetized neutral hydrogen seen by LOFAR
• Characterization of the polarized synchrotron emission from Planck and WMAP data
• The Atacama Cosmology Telescope: Map-Based Noise Simulations for DR6
• The cosmic shallows I: interaction of CMB photons in extended galaxy halos
• Convolutional Neural Network-reconstructed velocity for kinetic SZ detection
• Full-sky, arcminute-scale, 3D models of Galactic microwave foreground dust emission based on filaments
• QUIJOTE scientific results -- VIII. Diffuse polarized foregrounds from component separation with QUIJOTE-MFI
• BeyondPlanck VII. Bayesian estimation of gain and absolute calibration for CMB experiments
• Dust polarization spectral dependence from Planck HFI data. Turning point on CMB polarization foregrounds modelling
• Lack-of-correlation anomaly in CMB large scale polarisation maps
• A novel CMB polarization likelihood package for large angular scales built from combined WMAP and Planck LFI legacy maps
• Dust polarization modeling at large-scale over the Northern Galactic cap using EBHIS and Planck data
• Nature of Striation in 21 cm Channel Maps: Velocity Caustics
• BeyondPlanck X. Bandpass and beam leakage corrections
• Cosmoglobe DR1 results. I. Improved Wilkinson Microwave Anisotropy Probe maps through Bayesian end-to-end analysis
• Prospects of Searching for Type Ia Supernovae with 2.5-m Wide Field Survey Telescope
• BeyondPlanck XI. Bayesian CMB analysis with sample-based end-to-end error propagation
• Clustering of Local Extrema in Planck CMB maps
• BeyondPlanck VI. Noise characterization and modelling
• Impact of half-wave plate systematics on the measurement of cosmic birefringence from CMB polarization
• Characterizing three-dimensional magnetic field, turbulence, and self-gravity in the star-forming region L1688
• A peek outside our Universe
• Isotropy statistics of CMB hot and cold spots
• Explaining Excess Dipole in NVSS Data Using Superhorizon Perturbation
• High-resolution CMB bispectrum estimator with flexible modal basis
• A numerical study of observational systematic errors in lensing analysis of CMB polarization
• Detection of cross-correlation between CMB Lensing and low-density points
• Reconstructing Cosmic Polarization Rotation with ResUNet-CMB
• Cosmological Parameter Estimation Using Current and Future Observations of Strong Gravitational Lensing
• The galaxy power spectrum from TGSS ADR1 and the effect of flux calibration systematics
• Multipole expansion for 21cm Intensity Mapping power spectrum: forecasted cosmological parameters estimation for the SKA Observatory
• The link between E-B polarization modes and gas column density from interstellar dust emission
• Production of primordial black holes in improved E-models of inflation
• The Quantum Memory Matrix: A Unified Framework for the Black Hole Information Paradox
• How to avoid X'es around point sources in maximum likelihood CMB maps
• Study of a viscous $\Lambda$WDM model: Near equilibrium condition, entropy production, and cosmological constraints
• Application of Contour Minkowski Tensor and $\mathcal{D}$ Statistic to the Planck $E$-mode data
• Reassessment of the dipole in the distribution of quasars on the sky
• Testing for spectral index variations in polarised CMB foregrounds
• Graviton to photon conversion in curved space-time and external magnetic field
• Constraints on ${\tau }_{\mathrm{NL}}$ from Planck temperature and polarization
• Modeling parity-violating spectra in Galactic dust polarization with filaments and its applications to cosmic birefringence searches
• Star formation and accretion rates within 500 pc as traced by Gaia DR3 XP spectra
• A Synergy of the Velocity Gradients Technique and the Probability Density Functions for Identifying Gravitational Collapse in Self-Absorbing Media
• Preheating and Reheating Constraints in Supersymmetric Braneworld Inflation
• Cosmoglobe: Simulating zodiacal emission with ZodiPy
• Local patch analysis for testing statistical isotropy of the Planck convergence map
• Improved large scales interstellar dust foreground model and CMB solar dipole measurement
• The role of $T_0$ in CMB anisotropy measurements
• Analysis of Polarized Dust Emission Using Data from the First Flight of SPIDER
• Review on the minimally extended varying speed of light model
• Discord in Concordance Cosmology and Anomalously Massive Early Galaxies
• The PICASSO map-making code: application to a simulation of the QUIJOTE northern sky survey
• The Kinematic Structure of Magnetically Aligned HI Filaments
• Impact of Galactic dust non-Gaussianity on searches for B-modes from inflation
• Statistical properties of polarized CMB foreground maps
• BeyondPlanck X. Planck LFI frequency maps with sample-based error propagation
• A Comparison of Multi-Phase Magnetic Field Tracers in a High-Galactic Latitude Region of the Filamentary Interstellar Medium
• The CMB cold spot under the lens: ruling out a supervoid interpretation
• Relative alignment between gas structures and magnetic field in Orion A at different scales using different molecular gas tracers
• Constraints on the non-thermal desorption of methanol in the cold core LDN 429-C
• New Constraints on Lorentz Invariance Violation from Combined Linear and Circular Optical Polarimetry of Extragalactic Sources
• Cosmic dipole tensions: confronting the cosmic microwave background with infrared and radio populations of cosmological sources
• Confirming ALMA Calibration using Planck and ACT Observations
• A Simulation-Based Method for Correcting Mode Coupling in CMB Angular Power Spectra
• Effects of a Late Gravitational Transition on Gravitational Waves and Anticipated Constraints
• Evaluation of the single-component thermal dust emission model in CMB experiments
• One-point statistics matter in extended cosmologies
• Spectral imaging of the thermal Sunyaev-Zel'dovich effect in X-COP galaxy clusters: method and validation
• Statistics of non-polarized points in the CMB polarization maps
• An Independent Measure of the Kinematic Dipole from SDSS
• Systematic error mitigation for the PIXIE Fourier transform spectrometer
• Shear, writhe and filaments: turbulence in the high latitude molecular cloud MBM 40
• A Hubble Constant Determination Through Quasar Time Delays and Type Ia Supernovae
• Making a Quantum Universe: Symmetry and Gravity
• MAPPRAISER: A massively parallel map-making framework for multi-kilo pixel CMB experiments
• Exploring Anisotropic Lorentz Invariance Violation from the Spectral-Lag Transitions of Gamma-Ray Bursts
• The anomaly of the CMB power with the latest Planck data
• Properties of 3D HI Filaments in the Smith High Velocity Cloud
• Constraining the average magnetic field in galaxy clusters with current and upcoming CMB surveys
• Induced Cosmological Anisotropies and CMB Anomalies by a non-Abelian Gauge-Gravity Interaction
• Polarization and variability of compact sources measured in Planck time-ordered data
• The Galactic interstellar medium has a preferred handedness of magnetic misalignment
• Probing the Cosmic Distance Duality Relation via Non-Parametric Reconstruction for High Redshifts
• The XFaster Power Spectrum and Likelihood Estimator for the Analysis of Cosmic Microwave Background Maps
• Associating LOFAR Galactic Faraday structures with the warm neutral medium
• The End of the Road for Far-infrared Reddening Maps? Evidence for Reddening Errors Driven by Changes in PAH Abundance
• Dark Matter Searches with Top Quarks
• Breaking the degeneracy between polarization efficiency and cosmological parameters in CMB experiments
• Cross-correlating IceCube neutrinos with a large set of galaxy samples around redshift z ~ 1
• A Monte Carlo comparison between template-based and Wiener-filter CMB dipole estimators
• Effects of observer peculiar motion on the isotropic background frequency spectrum: from monopole to higher multipoles
• Constraints on the Helium Abundance from Fast Radio Bursts
• Statistical properties of Galactic synchrotron temperature and polarization maps -- a multi-frequency comparison
• A Minkowski Functional Analysis of the Cosmic Microwave Background Weak Lensing Convergence
• CMB bispectrum constraints on DHOST inflation
• Galactic foreground constraints on primordial $B$-mode detection for ground-based experiments
• Limits on Polarized Dust Spectral Index Variations for CMB Foreground Analysis
• A dark matter WIMP that can be detected and definitively identified with currently planned experiments
• Linear Relativistic Corrections in the Spherical Fourier-Bessel Power Spectrum
• $SU(\infty )$ Quantum Gravity and Cosmology
• Deep Needlet: A CNN based full sky component separation method in Needlet space
• Solid Identification of Extragalactic Gamma-Ray Source Using High-Resolution Radio Interferometric Observation
• Constraints on primordial non-Gaussianity from Planck PR4 data
• Predictions for the diffuse cosmic dipole at radio frequencies from reionization imprints
• Core to Cosmic Edge: SIMBA-C's New Take on Abundance Profiles in the Intragroup Medium at z = 0
• Effects of boosting on extragalactic components: methods and statistical studies
• The Universe is Brighter in the Direction of Our Motion: Galaxy Counts and Fluxes are Consistent with the CMB Dipole
• SPECTER: An Instrument Concept for CMB Spectral Distortion Measurements with Enhanced Sensitivity
• SRoll3: A neural network approach to reduce large-scale systematic effects in the Planck High Frequency Instrument maps
• Study of Ultra-High-Energy Gamma-Ray Source 1LHAASO J0056+6346u and Its Possible Origins
• Sub-Planckian scale and limits for $f(R)$ models
• On the Impact of Random Residual Calibration Error on the Gibbs ILC Estimates over Large Angular Scales
• Evolution of the early universe in Einstein-Cartan theory
• Gravitational Wave Memory Imprints on the CMB from Populations of Massive Black Hole Mergers
• Cosmic rays, gas and dust in the Central Molecular Zone I -- $X_{CO}$ factors, cosmic-ray densities and dust opacities
• Cosmoglobe: Towards end-to-end CMB cosmological parameter estimation without likelihood approximations
• Polarization fraction of Planck Galactic cold clumps and forecasts for the Simons Observatory
• Violation of Bell inequalities from Cosmic Microwave Background data
• Theoretical Radio Signals from Radio-Band Gravitational Waves Converted from the Neutron Star Magnetic Field
• Constraining the primordial power spectrum using a differentiable likelihood
• A three-dimensional reconstruction of the interstellar magnetic field toward a star-forming region
• In-flight gain monitoring of SPIDER's transition-edge sensor arrays
• Inflation Story: slow-roll and beyond
• Parallel and Perpendicular Alignments of Velocity Gradient and Magnetic Field observed in the Molecular Clouds L1478 and L1482
• Refracted Gravity Solutions from Small to Large Scales
• The Impact of Expanding HII Regions on Filament G37:Curved Magnetic Field and Multiple Direction Material Flows
• Bayesian inference methodology to characterize the dust emissivity at far-infrared and submillimeter frequencies
• Performance of the polarization leakage correction in the PILOT data
• A Partial-Sky Gibbs ILC Approach for the Estimation of CMB Posterior over Large Angular Scales of the Sky
• Design of the on-board data compression for the bolometer data of LiteBIRD
• SKYSURF-11: A New Zodiacal Light Model Optimized for Optical Wavelengths
• Cosmic magnification on high-redshift submillimeter galaxies
• A Quantitative Framework for Testing the Hubble Tension in a Bianchi Type I Cosmological Background
• Do We Have Sufficient Knowledge of the Galactic Foreground Emission in Cosmic Microwave Background Science?
• The Gaia Astrometric Catalogue and Secular Aberration Drift in Proper Motions
• Dynamics of a homogeneous and isotropic space in pure cubic f(R) gravity
• Zero-polarization candidate regions for calibration of wide-field optical polarimeters
• Beam-deconvolved Planck LFI maps
• Description and Application of the Surfing Effect
• Primordial Magnetogenesis from Killing Vector Fields
• Exiting Inflation with a Smooth Scale Factor
• Combining Planck and SPT cluster catalogs: cosmological analysis and impact on Planck scaling relation calibration
• BICEP/Keck XXI: Constraints on Early-Universe Parity Violation from Multipole-Dependent Birefringence