Data Compression for the Tomo-e Gozen with Low-rank Matrix Approximation
arXiv:1612.03994 · doi:10.3847/1538-4357/835/1/1
Abstract
Optical wide-field surveys with a high cadence are expected to create a new field of astronomy, so-called "movie astronomy," in the near future. The amount of data of the observations will be huge, and hence efficient data compression will be indispensable. Here we propose a low-rank matrix approximation with sparse matrix decomposition as a promising solution to reduce the data size effectively, while preserving sufficient scientific information. We apply one of the methods to the movie data obtained with the prototype model of the Tomo-e Gozen mounted on the 1.0-m Schmidt telescope of Kiso Observatory. Once the full-scale observation of the Tomo-e Gozen commences, it will generate ~30 TB of data per night. We demonstrate that the data are compressed by a factor of about 10 in size without losing transient events like optical short transient point-sources and meteors. The intensity of point sources can be recovered from the compressed data. The processing runs sufficiently fast, compared with the expected data-acquisition rate in the actual observing runs.
7 pages, 7 figures, Accepted for publication in ApJ
References in corpus (12)
- The Palomar Transient Factory: System Overview, Performance and First Results
- Exploring the Optical Transient Sky with the Palomar Transient Factory
- Radiative Transfer Simulations for Neutron Star Merger Ejecta
- A Fast Radio Burst Host Galaxy
- Large Synoptic Survey Telescope: Overview
- Gamma Ray Bursts
- Shock Breakout and Early Light Curves of Type II-P Supernovae Observed with Kepler
- Rapidly Rising Transients from Subaru Hyper Suprime-Cam Transient Survey
- Kiso Supernova Survey (KISS): Survey Strategy
- Machine-learning Selection of Optical Transients in Subaru/Hyper Suprime-Cam Survey
- Discovery of Dramatic Optical Variability in SDSS J1100+4421: A Peculiar Radio-Loud Narrow-Line Seyfert 1 Galaxy?
- Singular Value Decomposition of Images from Scanned Photographic Plates
Cited by in corpus (23)
- The lifecycle of molecular clouds in nearby star-forming disc galaxies
- Inferring the astrophysics of reionization and cosmic dawn from galaxy luminosity functions and the 21-cm signal
- The ALMA view of GMCs in NGC 300: Physical Properties and Scaling Relations at 10 pc Resolution
- The BAyesian STellar Algorithm (BASTA): a fitting tool for stellar studies, asteroseismology, exoplanets, and Galactic archaeology
- Sculpting Andromeda -- made-to-measure models for M31's bar and composite bulge: dynamics, stellar and dark matter mass
- The Radio Synchrotron Background: Conference Summary and Report
- The Gaia -ESO Survey: Lithium enrichment histories of the Galactic thick and thin disc
- Chasing Lyman alpha-emitting galaxies at z = 8.8
- Minimum size of 21-cm simulations
- Constraining the pitch angle of the Galactic spiral arms in the Milky Way
- Fermi observations of the LIGO event GW170104
- Growth Rate and Configurational Entropy in Tsallis Holographic Dark Energy
- Globally visible singularity in an astrophysical setup
- The Interplay of the Solar Wind Core and Suprathermal Electrons: A Quasilinear Approach for Firehose Instability
- A Long-term study of three rotating radio transients
- Systematic Differences in Spectroscopic Analysis of Red Giants
- Discovery and timing of three millisecond pulsars in radio and gamma-rays with the GMRT and Fermi-LAT
- Enabling near real-time remote search for fast transient events with lossy data compression
- A data-scientific noise-removal method for efficient submillimeter spectroscopy with single-dish telescopes
- "Slow-Scanning" in Ground-Based Mid-Infrared Observation
- Stellar evolution and modelling stars
- Configurational Entropy in Chaplygin Gas Models
- Synchrotron emission from a nearby zone of SgrA