Lossless Astronomical Image Compression and the Effects of Noise
arXiv:0903.2140 · doi:10.1086/599023
Abstract
We compare a variety of lossless image compression methods on a large sample of astronomical images and show how the compression ratios and speeds of the algorithms are affected by the amount of noise in the images. In the ideal case where the image pixel values have a random Gaussian distribution, the equivalent number of uncompressible noise bits per pixel is given by Nbits =log2(sigma * sqrt(12)) and the lossless compression ratio is given by R = BITPIX / Nbits + K where BITPIX is the bit length of the pixel values and K is a measure of the efficiency of the compression algorithm. We perform image compression tests on a large sample of integer astronomical CCD images using the GZIP compression program and using a newer FITS tiled-image compression method that currently supports 4 compression algorithms: Rice, Hcompress, PLIO, and GZIP. Overall, the Rice compression algorithm strikes the best balance of compression and computational efficiency; it is 2--3 times faster and produces about 1.4 times greater compression than GZIP. The Rice algorithm produces 75%--90% (depending on the amount of noise in the image) as much compression as an ideal algorithm with K = 0. The image compression and uncompression utility programs used in this study (called fpack and funpack) are publicly available from the HEASARC web site. A simple command-line interface may be used to compress or uncompress any FITS image file.
20 pages, 9 figures, to be published in PASP
Cited by in corpus (17)
- Second Data Release of the Hyper Suprime-Cam Subaru Strategic Program
- The Data Reduction Pipeline for the Apache Point Observatory Galactic Evolution Experiment
- SkyMapper Southern Survey: First Data Release (DR1)
- The KELT-South Telescope
- Euclid. III. The NISP Instrument
- Statistical Signatures of Nanoflare Activity. I. Monte Carlo Simulations and Parameter-space Exploration
- Web-Based Visualization of Very Large Scientific Astronomy Imagery
- Learning from FITS: Limitations in use in modern astronomical research
- Sky Subtraction in an Era of Low Surface Brightness Astronomy
- HDFITS: porting the FITS data model to HDF5
- Interactive Visualization of the Largest Radioastronomy Cubes
- An asynchronous object-oriented approach to the automation of the 0.8-meter George Mason University campus telescope in Python
- Optimal DN encoding for CCD detectors
- Data compression for the First G-APD Cherenkov Telescope
- A High-Throughput AES-GCM Implementation on GPUs for Secure, Policy-Based Access to Massive Astronomical Catalogs
- Lossless compression of simulated radio interferometric visibilities
- Quantifying the effect of image compression on supervised learning applications in optical microscopy