AMM: Adaptive Multilinear Meshes

Abstract

Adaptive representations are increasingly indispensable for reducing the in-memory and on-disk footprints of large-scale data. Usual solutions are designed broadly along two themes: reducing data precision, e.g., through compression, or adapting data resolution, e.g., using spatial hierarchies. Recent research suggests that combining the two approaches, i.e., adapting both resolution and precision simultaneously, can offer significant gains over using them individually. However, there currently exist no practical solutions to creating and evaluating such representations at scale. In this work, we present a new resolution-precision-adaptive representation to support hybrid data reduction schemes and offer an interface to existing tools and algorithms. Through novelties in spatial hierarchy, our representation, Adaptive Multilinear Meshes (AMM), provides considerable reduction in the mesh size. AMM creates a piecewise multilinear representation of uniformly sampled scalar data and can selectively relax or enforce constraints on conformity, continuity, and coverage, delivering a flexible adaptive representation. AMM also supports representing the function using mixed-precision values to further the achievable gains in data reduction. We describe a practical approach to creating AMM incrementally using arbitrary orderings of data and demonstrate AMM on six types of resolution and precision datastreams. By interfacing with state-of-the-art rendering tools through VTK, we demonstrate the practical and computational advantages of our representation for visualization techniques. With an open-source release of our tool to create AMM, we make such evaluation of data reduction accessible to the community, which we hope will foster new opportunities and future data reduction schemes

References in corpus (5)

• Formation of Hard Power-laws in the Energetic Particle Spectra Resulting from Relativistic Magnetic Reconnection
• Significantly Improving Lossy Compression for Scientific Data Sets Based on Multidimensional Prediction and Error-Controlled Quantization
• TTHRESH: Tensor Compression for Multidimensional Visual Data
• A Survey of High Level Frameworks in Block-Structured Adaptive Mesh Refinement Packages
• An open and parallel multiresolution framework using block-based adaptive grids

Cited by in corpus (4)

• Deep Hierarchical Super Resolution for Scientific Data
• Web-based Visualization and Analytics of Petascale data: Equity as a Tide that Lifts All Boats
• STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data
• The Beauty of Anisotropic Mesh Refinement: Omnitrees for Efficient Dyadic Discretizations