LeMoNADe: Learned Motif and Neuronal Assembly Detection in calcium imaging videos

Abstract

Neuronal assemblies, loosely defined as subsets of neurons with reoccurring spatio-temporally coordinated activation patterns, or "motifs", are thought to be building blocks of neural representations and information processing. We here propose LeMoNADe, a new exploratory data analysis method that facilitates hunting for motifs in calcium imaging videos, the dominant microscopic functional imaging modality in neurophysiology. Our nonparametric method extracts motifs directly from videos, bypassing the difficult intermediate step of spike extraction. Our technique augments variational autoencoders with a discrete stochastic node, and we show in detail how a differentiable reparametrization and relaxation can be used. An evaluation on simulated data, with available ground truth, reveals excellent quantitative performance. In real video data acquired from brain slices, with no ground truth available, LeMoNADe uncovers nontrivial candidate motifs that can help generate hypotheses for more focused biological investigations.

References in corpus (11)

• Auto-Encoding Variational Bayes
• Categorical Reparameterization with Gumbel-Softmax
• The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
• Variational Dropout and the Local Reparameterization Trick
• Composing graphical models with neural networks for structured representations and fast inference
• Cell assemblies at multiple time scales with arbitrary lag constellations
• Automatic Neuron Detection in Calcium Imaging Data Using Convolutional Networks
• A structured matrix factorization framework for large scale calcium imaging data analysis
• On the Partition Function and Random Maximum A-Posteriori Perturbations
• Nonparametric Variational Auto-encoders for Hierarchical Representation Learning
• Fast amortized inference of neural activity from calcium imaging data with variational autoencoders