6 papers
Generative Latent Diffusion for Efficient Spatiotemporal Data Reduction
Xiao Li, Liangji Zhu, Anand Rangarajan +1
Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representati…
Guaranteed Conditional Diffusion: 3D Block-based Models for Scientific Data Compression
Jaemoon Lee, Xiao Li, Liangji Zhu +2
This paper proposes a new compression paradigm -- Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) -- for lossy scientific data compression. The framework is based o…
Foundation Model for Lossy Compression of Spatiotemporal Scientific Data
Xiao Li, Jaemoon Lee, Anand Rangarajan +1
We present a foundation model (FM) for lossy scientific data compression, combining a variational autoencoder (VAE) with a hyper-prior structure and a super-resolution (SR) module.…
Attention Based Machine Learning Methods for Data Reduction with Guaranteed Error Bounds
Xiao Li, Jaemoon Lee, Anand Rangarajan +1
Scientific applications in fields such as high energy physics, computational fluid dynamics, and climate science generate vast amounts of data at high velocities. This exponential…
Machine Learning Techniques for Data Reduction of Climate Applications
Xiao Li, Qian Gong, Jaemoon Lee +3
Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals…
Machine Learning Techniques for Data Reduction of CFD Applications
Jaemoon Lee, Ki Sung Jung, Qian Gong +5
We present an approach called guaranteed block autoencoder that leverages Tensor Correlations (GBATC) for reducing the spatiotemporal data generated by computational fluid dynamics…