Digital-twin imaging based on descattering Gaussian splatting

Abstract

Three-dimensional imaging through scattering media is important in medical science and astronomy. We propose a digital-twin imaging method based on Gaussian splatting to observe an object behind a scattering medium. A digital twin model built through data assimilation, emulates the behavior of objects and environmental changes in a virtual space. By constructing a digital twin using point clouds composed of Gaussians and simulating the scattering process through the convolution of a point spread function, three-dimensional objects behind a scattering medium can be reproduced as a digital twin. In this study, a high-contrast digital twin reproducing a three-dimensional object was successfully constructed from degraded images, assuming that data were acquired from wavefronts disturbed by a scattering medium. This technique reproduces objects by integrating data processing with image measurements.

References in corpus (10)

• Measuring the Transmission Matrix in Optics : An Approach to the Study and Control of Light Propagation in Disordered Media
• Non-invasive real-time imaging through scattering layers and around corners via speckle correlations
• Controlling Light Through Optical Disordered Media : Transmission Matrix Approach
• Roadmap on Wavefront Shaping and deep imaging in complex media
• Non-invasive focusing and imaging in scattering media with a fluorescence-based transmission matrix
• 3D Gaussian Splatting for Real-Time Radiance Field Rendering
• Large-scale holographic particle 3D imaging with the beam propagation model
• Deblurring 3D Gaussian Splatting
• Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
• Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion