Quantization of Fully Convolutional Networks for Accurate Biomedical Image Segmentation

Abstract

With pervasive applications of medical imaging in health-care, biomedical image segmentation plays a central role in quantitative analysis, clinical diagno- sis, and medical intervention. Since manual anno- tation su ers limited reproducibility, arduous e orts, and excessive time, automatic segmentation is desired to process increasingly larger scale histopathological data. Recently, deep neural networks (DNNs), par- ticularly fully convolutional networks (FCNs), have been widely applied to biomedical image segmenta- tion, attaining much improved performance. At the same time, quantization of DNNs has become an ac- tive research topic, which aims to represent weights with less memory (precision) to considerably reduce memory and computation requirements of DNNs while maintaining acceptable accuracy. In this paper, we apply quantization techniques to FCNs for accurate biomedical image segmentation. Unlike existing litera- ture on quantization which primarily targets memory and computation complexity reduction, we apply quan- tization as a method to reduce over tting in FCNs for better accuracy. Speci cally, we focus on a state-of- the-art segmentation framework, suggestive annotation [22], which judiciously extracts representative annota- tion samples from the original training dataset, obtain- ing an e ective small-sized balanced training dataset. We develop two new quantization processes for this framework: (1) suggestive annotation with quantiza- tion for highly representative training samples, and (2) network training with quantization for high accuracy. Extensive experiments on the MICCAI Gland dataset show that both quantization processes can improve the segmentation performance, and our proposed method exceeds the current state-of-the-art performance by up to 1%. In addition, our method has a reduction of up to 6.4x on memory usage.

9 pages, 11 Figs, 1 Table, Accepted by CVPR

References in corpus (6)

• BinaryConnect: Training Deep Neural Networks with binary weights during propagations
• DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
• Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
• Ternary Weight Networks
• Trained Ternary Quantization
• Gland Instance Segmentation Using Deep Multichannel Neural Networks

Cited by in corpus (10)

• Diminishing Uncertainty within the Training Pool: Active Learning for Medical Image Segmentation
• DLBC: A Deep Learning-Based Consensus in Blockchains for Deep Learning Services
• Quantization of Deep Neural Networks for Accurate Edge Computing
• Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators
• Real-Time Boiler Control Optimization with Machine Learning
• PBGen: Partial Binarization of Deconvolution-Based Generators for Edge Intelligence
• Towards Cardiac Intervention Assistance: Hardware-aware Neural Architecture Exploration for Real-Time 3D Cardiac Cine MRI Segmentation
• Privacy-Aware Cost-Effective Scheduling Considering Non-Schedulable Appliances in Smart Home
• ICA-UNet: ICA Inspired Statistical UNet for Real-time 3D Cardiac Cine MRI Segmentation
• Accurate Congenital Heart Disease Model Generation for 3D Printing