The intrinsic dimensionality of spectro-polarimetric data

Abstract

The amount of information available in spectro-polarimetric data is estimated. To this end, the intrinsic dimensionality of the data is inferred with the aid of a recently derived estimator based on nearest-neighbor considerations and obtained applying the principle of maximum likelihood. We show in detail that the estimator correctly captures the intrinsic dimension of artificial datasets with known dimension. The effect of noise in the estimated dimension is analyzed thoroughly and we conclude that it introduces a positive bias that needs to be accounted for. Real simultaneous spectro-polarimetric observations in the visible 630 nm and the near-infrared 1.5 microns spectral regions are also investigated in detail, showing that the near-infrared dataset provides more information of the physical conditions in the solar atmosphere than the visible dataset. Finally, we demonstrate that the amount of information present in an observed dataset is a monotonically increasing function of the number of available spectral lines.

12 pages, 7 figures, accepted for publication in the Astrophysical Journal

References in corpus (2)

• On the validity of the 630 nm Fe I nm lines for the magnetometry of the internetwork quiet Sun
• The Minimum Description Length Principle and Model Selection in Spectropolarimetry

Cited by in corpus (20)

• Inversion of the radiative transfer equation for polarized light
• Stokes Inversion based on Convolutional Neural Networks
• BayesCLUMPY: Bayesian Inference with Clumpy Dusty Torus Models
• Internetwork magnetic field distribution from simultaneous 1.56 micron and 630 nm observations
• PCA detection and denoising of Zeeman signatures in stellar polarised spectra
• Unsupervised learning universal critical behavior via the intrinsic dimension
• A fast method for Stokes profile synthesis -- Radiative transfer modeling for ZDI and Stokes profile inversion
• Chromospheric polarimetry through multi-line observations of the 850 nm spectral region
• Machine learning initialization to accelerate Stokes profile inversions
• Zeeman-Tomography of the Solar Photosphere -- 3-Dimensional Surface Structures Retrieved from Hinode Observations
• Characterization of Solar Telescope Polarization Properties Across the Visible and Near-Infrared Spectrum. Case Study: The Dunn Solar Telescope
• A critical evaluation of PCA detection of polarized signatures using real stellar data
• Spectral deconvolution with deep learning: removing the effects of spectral PSF broadening
• Solar polarimetry in the K I $D_2$ line: A novel possibility for a stratospheric balloon
• Strength distribution of solar magnetic fields in photospheric quiet Sun regions
• High-precision interpolation of stellar atmospheres with a deep neural network using a 1D convolutional auto encoder for feature extraction
• Spectral resolution effects on the information content in solar spectra
• Neural translation for Stokes inversion and synthesis
• Bayesian Inversion of Stokes Profiles
• Compression Method for Solar Polarization Spectra Collected from Hinode SOT/SP Observations