CRISPRED: A data pipeline for the CRISP imaging spectropolarimeter

Abstract

The production of science-ready data from major solar telescopes requires expertise beyond that of the typical observer. This is a consequence of the increasing complexity of instruments and observing sequences, which require calibrations and corrections for instrumental and seeing effects that are not only difficult to measure, but are also coupled in ways that require careful analysis in the design of the correction procedures. Modern space-based telescopes have data-processing pipelines capable of routinely producing well-characterized data products. High-resolution imaging spectropolarimeters at ground-based telescopes need similar data pipelines. We present new methods for flat-fielding spectropolarimetric data acquired with telecentric Fabry-Perot instruments and a new approach for accurate camera co-alignment for image restoration. We document a procedure that forms the basis of current state of the art processing of data from the CRISP imaging spectropolarimeter at the Swedish 1-m Solar Telescope (SST). By collecting, implementing, and testing a suite of computer programs, we have defined a data reduction pipeline for this instrument. This pipeline, CRISPRED, streamlines the process of making science-ready data. It is implemented and operated in IDL, with time-consuming steps delegated to C. CRISPRED will be the basis also for the data pipeline of the forthcoming CHROMIS instrument.

Accepted for publication in Astronomy & Astrophysics

References in corpus (23)

• CRISP Spectropolarimetric Imaging of Penumbral Fine Structure
• The Imaging Magnetograph eXperiment (IMaX) for the Sunrise balloon-borne solar observatory
• Ubiquitous torsional motions in type II spicules
• The solar chromosphere at high resolution with IBIS. I. New insights from the Ca II 854.2 nm line
• Spatially coupled inversion of spectro-polarimetric image data I: Method and first results
• Flocculent flows in the chromospheric canopy of a sunspot
• Physical Properties of a Sunspot Chromosphere with Umbral Flashes
• Ellerman Bombs at high resolution: II. Visibility, triggering and effect on upper atmosphere
• Interplay of three kinds of motion in the disk counterpart of type II spicules: up-flow, transversal and torsional motions
• 3D Temperature Mapping of Solar Photospheric Fine Structure Using Ca II H Filtergrams
• Detection of vortex tubes in solar granulation from observations with Sunrise
• Stokes imaging polarimetry using image restoration at the Swedish 1-m Solar Telescope
• Are giant tornadoes the legs of solar prominences?
• Opposite polarity field with convective downflow and its relation to magnetic spines in a sunspot penumbra
• Short dynamic fibrils in sunspot chromospheres
• S-DIMM+ height characterization of day-time seeing using solar granulation
• The effect of isotopic splitting on the bisector and inversions of the solar Ca II 854.2 nm line
• Temporal Evolution of Velocity and Magnetic Field in and around Umbral Dots
• High-order aberration compensation with Multi-frame Blind Deconvolution and Phase Diversity image restoration techniques
• Analysis of Seeing-Induced Polarization Cross-Talk and Modulation Scheme Performance
• The GREGOR Fabry-Pérot Interferometer and its companion the Blue Imaging Solar Spectrometer
• Stokes imaging polarimetry using image restoration: A calibration strategy for Fabry-Pérot based instruments
• Sources of straylight in the post-focus imaging instrumentation of the Swedish 1-m Solar Telescope

Cited by in corpus (157)

• On the generation of solar spicules and Alfvénic waves
• Bombs and flares at the surface and lower atmosphere of the Sun
• Ellerman bombs at high resolution III. Simultaneous observations with IRIS and SST
• The multi-thermal and multi-stranded nature of coronal rain
• Halpha line profile asymmetries and the chromospheric flare velocity field
• Intermittent reconnection and plasmoids in UV bursts in the low solar atmosphere
• SSTRED: Data- and metadata-processing pipeline for CHROMIS and CRISP
• Mapping the magnetic field of flare coronal loops
• On fibrils and field lines: The nature of H$\alpha$ fibrils in the solar chromosphere
• Heating signatures in the disk counterparts of solar spicules in IRIS observations
• Three-dimensional modeling of the Ca II H&K lines in the solar atmosphere
• Magnetic Flux Cancellation in Ellerman Bombs
• Reconnection brightenings in the quiet solar photosphere
• Fan-shaped jets above the light bridge of a sunspot driven by reconnection
• Surges and Si IV bursts in the solar atmosphere. Understanding IRIS and SST observations through RMHD experiments
• Chromospheric condensations and magnetic field in a C3.6-class flare studied via He I D3 spectro-polarimetry
• Instrumentation for solar spectropolarimetry: state of the art and prospects
• Real-time multiframe blind deconvolution of solar images
• Explosive events in active region observed by IRIS and SST/CRISP
• Emergence of granular-sized magnetic bubbles through the solar atmosphere. II. Non-LTE chromospheric diagnostics and inversions
• Inference of the chromospheric magnetic field orientation in the Ca II 8542 A line fibrils
• Ellerman bombs and UV bursts: reconnection at different atmospheric layers
• Kelvin-Helmholtz instability in solar chromospheric jets: theory and observation
• Internetwork chromospheric bright grains observed with IRIS
• Quiet Sun Hα Transients and Corresponding Small-Scale Transition Region and Coronal Heating
• IRIS Burst Spectra Co-Spatial To A Quiet-Sun Ellerman-Like Brightening
• Three-dimensional modeling of chromospheric spectral lines in a simulated active region
• Observing the formation of flare-driven coronal rain
• Evidence for a Transition Region response to penumbral microjets in sunspots
• The Appearance of Spicules in High Resolution Observations of Ca II H and H-alpha
• Spectropolarimetric inversions of the Ca ii 8542 Å line in a M-class solar flare
• Dissecting bombs and bursts: non-LTE inversions of low-atmosphere reconnection in SST and IRIS observations
• Non-linear propagation of kink waves to the solar chromosphere
• On chromospheric heating during flux emergence in the solar atmosphere
• An observationally-constrained model of strong magnetic reconnection in the solar chromosphere. Atmospheric stratification and estimates of heating rates
• Spicules and downflows in the solar chromosphere
• The cause of spatial structure in solar He I 1083 nm multiplet images
• Solar image denoising with convolutional neural networks
• On the Active Region Bright Grains Observed in the Transition Region Imaging Channels of IRIS
• Multi-scale observations of thermal non-equilibrium cycles in coronal loops
• Stratification of physical parameters in a C-class solar flare using multi-line observations
• Convective blueshifts in the solar atmosphere, I. Absolute measurements with LARS of the spectral lines at 6302 Å
• Magnetic field variations associated with umbral flashes and penumbral waves
• Signatures of ubiquitous magnetic reconnection in the lower solar atmosphere
• Inference of the chromospheric magnetic field configuration of solar plage using the Ca II 8542 Å line
• A Hot Downflowing Model Atmosphere For Umbral Flashes And The Physical Properties Of Their Dark Fibrils
• First simultaneous SST/CRISP and IRIS observations of a small-scale quiet Sun vortex
• Chromospheric heating due to cancellation of quiet Sun internetwork fields
• Observationally based models of penumbral microjets
• A comparative study of two X2.2 and X9.3 solar flares observed with HARPS-N: Reconciling Sun-as-a-star spectroscopy and high-spatial resolution solar observations in the context of the solar-stellar connection
• Automated Swirl Detection Algorithm (ASDA) and Its Application to Simulation and Observational Data
• Observations and 3D MHD Modeling of a Confined Helical Jet Launched by a Filament Eruption
• Ellerman bombs at high resolution. IV. Visibility in Na I and Mg I
• Spatio-temporal analysis of chromospheric heating in a plage region
• Spectroscopic inversions of the Ca ii 8542 Å line in a C-class solar flare
• Ultra-high resolution observations of plasmoid-mediated magnetic reconnection in the deep solar atmosphere
• Center-to-limb variation of spectral lines and continua observed with SST/CRISP and SST/CHROMIS
• Non-LTE inversions of a confined X2.2 flare: I. Vector magnetic field in the photosphere and chromosphere
• Semi-empirical model atmospheres for the chromosphere of the sunspot penumbra and umbral flashes
• Properties of ubiquitous magnetic reconnection events in the lower solar atmosphere
• Physical properties of bright Ca II K fibrils in the solar chromosphere
• Lateral downflows in sunspot penumbral filaments and their temporal evolution
• RADYNVERSION: Learning to Invert a Solar Flare Atmosphere with Invertible Neural Networks
• Active region chromospheric magnetic fields
• Emergence of granular-sized magnetic bubbles through the solar atmosphere. III. The path to the transition region
• Microjets in the penumbra of a sunspot
• High-resolution observations of the solar photosphere, chromosphere and transition region. A database of coordinated IRIS and SST observations
• Heating of the solar chromosphere through current dissipation
• Diagnostic potential of the Ca II 8542A line for solar filaments
• Umbral chromospheric fine structure and umbral flashes modelled as one: the corrugated umbra
• High--cadence observations of spicular-type events on the Sun
• The formation of small-scale umbral brightenings in sunspot atmospheres
• Automating Ellerman bomb detection in ultraviolet continua
• The chromosphere underneath a Coronal Bright Point
• Dynamics of internetwork chromospheric fibrils: Basic properties and MHD kink waves
• Prospects of solar magnetometry - from ground and in space
• Energetics of magnetic transients in a solar active region plage
• Solar oxygen abundance using SST/CRISP center-to-limb observations of the O I 7772 Å line
• Stable Umbral Chromospheric Structures
• High-resolution observations of recurrent jets from an arch filament system
• Transverse motions in sunspot super-penumbral fibrils
• Chromospheric swirls I. Automated detection in H$\alpha$ observations and their statistical properties
• Deciphering the solar coronal heating: Energizing small-scale loops through surface convection
• Slipping reconnection in a solar flare observed in high resolution with the GREGOR solar telescope
• The magnetic properties of photospheric magnetic bright points with high resolution spectropolarimetry
• Learning to do multiframe wavefront sensing unsupervisedly: applications to blind deconvolution
• The chromosphere above a $\delta$-sunspot in the presence of fan-shaped jets
• Spectral variations within solar flare ribbons
• sTools - a data reduction pipeline for the GREGOR Fabry-Pérot Interferometer and the High-resolution Fast Imager at the GREGOR solar telescope
• Spectral diagnostics of cool flare loops observed by SST: I. Inversion of the Ca II 8542 Å and H$\beta$ lines
• Spatially resolved signatures of bi-directional flows observed in inverted-Y shaped jets
• Chromospheric observations and magnetic configuration of a supergranular structure
• Chromospheric counterparts of solar transition region unresolved fine structure loops
• The Chromospheric Response to the Sunquake generated by the X9.3 Flare of NOAA 12673
• High-resolution imaging spectroscopy of two micro-pores and an arch filament system in a small emerging-flux region
• Properties of shock waves in the quiet Sun chromosphere
• Signatures of ubiquitous magnetic reconnection in the deep atmosphere of sunspot penumbrae
• Generic low-atmosphere signatures of swirled-anemone jets
• Design and Performance Analysis of a Highly Efficient Polychromatic Full-Stokes Polarization Modulator for the CRISP Imaging Spectrometer
• 1D atmosphere models from inversion of Fe I 630 nm observations with an application to solar irradiance studies
• Photospheric magnetic topology of a north polar region
• Kinematics and Magnetic Properties of a Light Bridge in a Decaying Sunspot
• H-alpha features with hot onsets. II. A contrail fibril
• Penumbral decay observed in active region NOAA 12585
• Interaction of magnetic fields with a vortex tube at solar subgranular scale
• Small-scale magnetic flux emergence preceding a chain of energetic solar atmospheric events
• Synthesizing Sun-as-a-star flare spectra from high-resolution solar observations
• Magnetic field inference in active region coronal loops using coronal rain clumps
• Ubiquitous hundred-Gauss magnetic fields in solar spicules
• High flow speeds and transition-region like temperatures in the solar chromosphere during flux emergence
• Estimating the longitudinal magnetic field in the chromosphere of quiet-Sun magnetic concentrations
• Properties of Supersonic Evershed Downflows
• New technique to measure the cavity defects of Fabry-Perot interferometers
• Physical properties of a fan-shaped jet backlit by an X9.3 flare
• Spectral Characteristics and Formation Height of Off-Limb Flare Ribbons
• Improved reconstruction of solar magnetic fields from imaging spectropolarimetry through spatio-temporal regularisation
• Investigating the effect of solar ambient and data characteristics on Ca II K observations and line profile measurements
• Penumbral micro-jets at high spatial and temporal resolution
• COCOPLOT: COlor COllapsed PLOTting software : Using color to view 3D data as a 2D image
• Magnetic upflow events in the quiet-Sun photosphere. I. Observations
• Transition region response to Quiet Sun Ellerman Bombs
• Semi-empirical models of spicule from inversion of Ca II 8542 Å line
• The effects of transients on photospheric and chromospheric power distributions
• Magnetic Topology of quiet-Sun Ellerman bombs and associated Ultraviolet brightenings
• A multi-diagnostic spectral analysis of penumbral microjets
• Fine details in solar flare ribbons: Statistical insights from observations with the Swedish 1-m Solar Telescope
• A reconnection driven magnetic flux cancellation and a quiet Sun Ellerman bomb
• The dark side of penumbral microjets: Observations in Hα
• Radiative losses in the chromosphere during a C-class flare
• A Machine Learning Approach to Correcting Atmospheric Seeing in Solar Flare Observations
• Small-scale dynamic phenomena associated with interacting fan-spine topologies: quiet-Sun Ellerman bombs, UV brightenings, and chromospheric inverted-Y-shaped jets
• Coronal kink oscillations and photospheric driving: combining SolO/EUI and SST/CRISP high-resolution observations
• The making of robust and highly performing imaging spectropolarimeters for large solar telescopes
• Temperature diagnostics of chromospheric fibrils
• Tracking downflows from the chromosphere to the photosphere in a solar arch filament system
• Chromospheric Inversions of a Micro-flaring Region
• High Resolution Observations of the Low Atmospheric Response to Small Coronal Heating Events in an Active Region Core
• Solar off-limb emission of the OI 7772 Å line
• Quantifying Properties of Photospheric Magnetic Cancellations in the Quiet Sun Internetwork
• A prototype of a large tunable Fabry-Perot interferometer for solar spectroscopy
• Stratification of canopy magnetic fields in a plage region. Constraints from a spatially-regularized weak-field approximation method
• Observations of umbral flashes in the resonant sunspot chromosphere
• Temporal evolution of short-lived penumbral microjets
• Quiet Sun Ellerman bombs as a possible proxy for reconnection-driven spicules
• Diagnosing the solar atmosphere through the Mg I b${}_2$ 5173 Å line. II. Morphological classification of the intensity and circular polarization profiles
• Analysis of Pseudo-Lyapunov Exponents of Solar Convection Using State-of-the-Art Observations
• Off-disk straylight measurements for the Swedish 1-meter Solar Telescope
• Transverse oscillations in 3D along Ca II K bright fibrils in the solar chromosphere
• Automatic detection of Ellerman bombs using Deep Learning
• torchmfbd: a flexible multi-object multi-frame blind deconvolution code
• On the Relationship between Solar Spicules and Propagating Coronal Disturbances: The Role of Shocks
• Dynamics and connectivity of an extended arch filament system
• Active chromospheric fibril singularity: Coordinated observations from Solar Orbiter, SST, and IRIS
• Spectral Background-Subtracted Activity Maps
• High-resolution spectropolarimetric observations of the temporal evolution of magnetic fields in photospheric bright points
• Emergence of internetwork magnetic fields through the solar atmosphere
• Decay of a photospheric transient filament at the boundary of a pore and the chromospheric response