Attention-Based Transformers for Instance Segmentation of Cells in Microstructures

Abstract

Detecting and segmenting object instances is a common task in biomedical applications. Examples range from detecting lesions on functional magnetic resonance images, to the detection of tumours in histopathological images and extracting quantitative single-cell information from microscopy imagery, where cell segmentation is a major bottleneck. Attention-based transformers are state-of-the-art in a range of deep learning fields. They have recently been proposed for segmentation tasks where they are beginning to outperforming other methods. We present a novel attention-based cell detection transformer (Cell-DETR) for direct end-to-end instance segmentation. While the segmentation performance is on par with a state-of-the-art instance segmentation method, Cell-DETR is simpler and faster. We showcase the method's contribution in a the typical use case of segmenting yeast in microstructured environments, commonly employed in systems or synthetic biology. For the specific use case, the proposed method surpasses the state-of-the-art tools for semantic segmentation and additionally predicts the individual object instances. The fast and accurate instance segmentation performance increases the experimental information yield for a posteriori data processing and makes online monitoring of experiments and closed-loop optimal experimental design feasible.

IEEE BIBM 2020 (accepted)

References in corpus (6)

• Decoupled Weight Decay Regularization
• MMDetection: Open MMLab Detection Toolbox and Benchmark
• Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
• Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks
• Maximizing Information Gain for the Characterization of Biomolecular Circuits
• Multiclass Yeast Segmentation in Microstructured Environments with Deep Learning

Cited by in corpus (14)

• A Survey on Visual Transformer
• Transformers in Vision: A Survey
• Boundary-aware Transformers for Skin Lesion Segmentation
• Towards Accurate Post-Training Quantization for Vision Transformer
• A Survey of Visual Transformers
• Medical Image Segmentation Using Squeeze-and-Expansion Transformers
• Video Crowd Localization with Multi-focus Gaussian Neighborhood Attention and a Large-Scale Benchmark
• Multi-StyleGAN: Towards Image-Based Simulation of Time-Lapse Live-Cell Microscopy
• Focused Decoding Enables 3D Anatomical Detection by Transformers
• Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels
• An Instance Segmentation Dataset of Yeast Cells in Microstructures
• Detection Transformer for Teeth Detection, Segmentation, and Numbering in Oral Rare Diseases: Focus on Data Augmentation and Inpainting Techniques
• Generation and Simulation of Yeast Microscopy Imagery with Deep Learning
• The TYC Dataset for Understanding Instance-Level Semantics and Motions of Cells in Microstructures