Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic training

Abstract

We present an automated method to track and identify neurons in C. elegans, called "fast Deep Learning Correspondence" or fDLC, based on the transformer network architecture. The model is trained once on empirically derived synthetic data and then predicts neural correspondence across held-out real animals via transfer learning. The same pre-trained model both tracks neurons across time and identifies corresponding neurons across individuals. Performance is evaluated against hand-annotated datasets, including NeuroPAL [1]. Using only position information, the method achieves 80.0% accuracy at tracking neurons within an individual and 65.8% accuracy at identifying neurons across individuals. Accuracy is even higher on a published dataset [2]. Accuracy reaches 76.5% when using color information from NeuroPAL. Unlike previous methods, fDLC does not require straightening or transforming the animal into a canonical coordinate system. The method is fast and predicts correspondence in 10 ms making it suitable for future real-time applications.

arXiv comment5 figures

References in corpus (8)

• Point-Set Registration: Coherent Point Drift
• Layer Normalization
• Deep learning tools for the measurement of animal behavior in neuroscience
• Whole-brain calcium imaging with cellular resolution in freely behaving C. elegans
• Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted light
• Automatically tracking neurons in a moving and deforming brain
• Simultaneous optogenetic manipulation and calcium imaging in freely moving C. elegans
• A probabilistic atlas for cell identification

Cited by in corpus (2)

• Neural signal propagation atlas of C. elegans
• Rapid detection and recognition of whole brain activity in a freely behaving Caenorhabditis elegans