Multiclass Weighted Loss for Instance Segmentation of Cluttered Cells

Abstract

We propose a new multiclass weighted loss function for instance segmentation of cluttered cells. We are primarily motivated by the need of developmental biologists to quantify and model the behavior of blood T-cells which might help us in understanding their regulation mechanisms and ultimately help researchers in their quest for developing an effective immuno-therapy cancer treatment. Segmenting individual touching cells in cluttered regions is challenging as the feature distribution on shared borders and cell foreground are similar thus difficulting discriminating pixels into proper classes. We present two novel weight maps applied to the weighted cross entropy loss function which take into account both class imbalance and cell geometry. Binary ground truth training data is augmented so the learning model can handle not only foreground and background but also a third touching class. This framework allows training using U-Net. Experiments with our formulations have shown superior results when compared to other similar schemes, outperforming binary class models with significant improvement of boundary adequacy and instance detection. We validate our results on manually annotated microscope images of T-cells.

Submitted to IEEE ICIP 2018

References in corpus (7)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Fully Convolutional Networks for Semantic Segmentation
• What makes for effective detection proposals?
• Gland Instance Segmentation Using Deep Multichannel Neural Networks
• DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation
• Multiclass Weighted Loss for Instance Segmentation of Cluttered Cells
• Towards Automatic 3D Shape Instantiation for Deployed Stent Grafts: 2D Multiple-class and Class-imbalance Marker Segmentation with Equally-weighted Focal U-Net

Cited by in corpus (8)

• Cell Detection with Star-convex Polygons
• Multiclass Weighted Loss for Instance Segmentation of Cluttered Cells
• Cell Segmentation by Combining Marker-Controlled Watershed and Deep Learning
• An Auxiliary Task for Learning Nuclei Segmentation in 3D Microscopy Images
• U-Net for MAV-based Penstock Inspection: an Investigation of Focal Loss in Multi-class Segmentation for Corrosion Identification
• Enhancing Cell Instance Segmentation in Scanning Electron Microscopy Images via a Deep Contour Closing Operator
• Mapping illegal waste dumping sites with neural-network classification of satellite imagery
• Classifying Breast Histopathology Images with a Ductal Instance-Oriented Pipeline