ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

Abstract

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to the next, which makes matching features across images a challenge. Advances in deep learning has resulted in unprecedented performance in similar computer vision problems, but to our knowledge, they have not been successfully applied to ssEM image co-registration. In this paper, we introduce a novel deep network model that combines a spatial transformer for image deformation and a convolutional autoencoder for unsupervised feature learning for robust ssEM image alignment. This results in improved accuracy and robustness while requiring substantially less user intervention than conventional methods. We evaluate our method by comparing registration quality across several datasets.

DLMIA 2017 accepted

References in corpus (3)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Cited by in corpus (12)

• Deep Learning in Medical Image Registration: A Review
• Deep Learning in Medical Image Registration: A Survey
• Medical Image Registration Using Deep Neural Networks: A Comprehensive Review
• A coarse-to-fine framework for unsupervised multi-contrast MR image deformable registration with dual consistency constraint
• Non-rigid image registration using fully convolutional networks with deep self-supervision
• Weakly-Supervised Learning of Metric Aggregations for Deformable Image Registration
• Non-Rigid Image Registration Using Self-Supervised Fully Convolutional Networks without Training Data
• Siamese Encoding and Alignment by Multiscale Learning with Self-Supervision
• A Two-Step Deep Learning Method for 3DCT-2DUS Kidney Registration During Breathing
• On Reducing Negative Jacobian Determinant of the Deformation Predicted by Deep Registration Networks
• MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision
• Convolutional nets for reconstructing neural circuits from brain images acquired by serial section electron microscopy