TTHRESH: Tensor Compression for Multidimensional Visual Data
arXiv:1806.05952 · doi:10.1109/TVCG.2019.2904063
Abstract
Memory and network bandwidth are decisive bottlenecks when handling high-resolution multidimensional data sets in visualization applications, and they increasingly demand suitable data compression strategies. We introduce a novel lossy compression algorithm for multidimensional data over regular grids. It leverages the higher-order singular value decomposition (HOSVD), a generalization of the SVD to three dimensions and higher, together with bit-plane, run-length and arithmetic coding to compress the HOSVD transform coefficients. Our scheme degrades the data particularly smoothly and achieves lower mean squared error than other state-of-the-art algorithms at low-to-medium bit rates, as it is required in data archiving and management for visualization purposes. Further advantages of the proposed algorithm include very fine bit rate selection granularity and the ability to manipulate data at very small cost in the compression domain, for example to reconstruct filtered and/or subsampled versions of all (or selected parts) of the data set.
Cited by in corpus (25)
- Tensor Methods in Computer Vision and Deep Learning
- 2022 Review of Data-Driven Plasma Science
- Fast Neural Representations for Direct Volume Rendering
- TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition
- CrimAnalyzer: Understanding Crime Patterns in São Paulo City
- MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring
- FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs
- AMM: Adaptive Multilinear Meshes
- Adaptively Placed Multi-Grid Scene Representation Networks for Large-Scale Data Visualization
- Deep Hierarchical Super Resolution for Scientific Data
- TAC: Optimizing Error-Bounded Lossy Compression for Three-Dimensional Adaptive Mesh Refinement Simulations
- Low-Rank Tucker Approximation of a Tensor From Streaming Data
- TAC+: Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations
- Compression challenges in large scale PDE solvers
- A General Framework for Augmenting Lossy Compressors with Topological Guarantees
- ATC: an Advanced Tucker Compression library for multidimensional data
- Multi-Dimensional Data Compression and Query Processing in Array Databases
- Efficient Neural Representation of Volumetric Data using Coordinate-Based Networks
- A General Framework for Error-controlled Unstructured Scientific Data Compression
- STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data
- A Visual Analytics Framework for Reviewing Multivariate Time-Series Data with Dimensionality Reduction
- Faster Math Functions, Soundly
- A framework for compressing unstructured scientific data via serialization
- A Versatile Depth Video Encoding Scheme Based on Low-rank Tensor Modeling for Free Viewpoint Video
- LCFI: A Fault Injection Tool for Studying Lossy Compression Error Propagation in HPC Programs