CATCH: Characterizing and Tracking Colloids Holographically using deep neural networks

Abstract

In-line holographic microscopy provides an unparalleled wealth of information about the properties of colloidal dispersions. Analyzing one colloidal particle's hologram with the Lorenz-Mie theory of light scattering yields the particle's three-dimensional position with nanometer precision while simultaneously reporting its size and refractive index with part-per-thousand resolution. Analyzing a few thousand holograms in this way provides a comprehensive picture of the particles that make up a dispersion, even for complex multicomponent systems. All of this valuable information comes at the cost of three computationally expensive steps: (1) identifying and localizing features of interest within recorded holograms, (2) estimating each particle's properties based on characteristics of the associated features, and finally (3) optimizing those estimates through pixel-by-pixel fits to a generative model. Here, we demonstrate an end-to-end implementation that is based entirely on machine-learning techniques. Characterizing and Tracking Colloids Holographically (CATCH) with deep convolutional neural networks is fast enough for real-time applications and otherwise outperforms conventional analytical algorithms, particularly for heterogeneous and crowded samples. We demonstrate this system's capabilities with experiments on free-flowing and holographically trapped colloidal spheres.

11 pages, 7 figures

References in corpus (10)

• YOLOv3: An Incremental Improvement
• Characterizing and tracking single colloidal particles with video holographic microscopy
• Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D
• Influence of non-conservative optical forces on the dynamics of optically trapped colloidal spheres: The fountain of probability
• Brownian Dynamics of a Sphere Between Parallel Walls
• Machine-learning techniques for fast and accurate feature localization in holograms of colloidal particles
• Imaging Multiple Colloidal Particles by Fitting Electromagnetic Scattering Solutions to Digital Holograms
• Above and beyond: Holographic tracking of axial displacements in holographic optical tweezers
• Large depth-of-field tracking of colloidal spheres in holographic microscopy by modeling the objective lens
• Stimulus-responsive colloidal sensors with fast holographic readout

Cited by in corpus (6)

• Quantitative Digital Microscopy with Deep Learning
• Microplankton life histories revealed by holographic microscopy and deep learning
• Identification of particle mixtures using machine-learning-assisted laser diffraction analysis
• Height Distribution and Orientation of Colloidal Dumbbells Near a Wall
• Multi-angle holographic characterization of individual fractal aggregates
• Identification of 2D colloidal assemblies in images: a threshold processing method versus machine learning