FAS-UNet: A Novel FAS-driven Unet to Learn Variational Image Segmentation
arXiv:2210.15164 · doi:10.3390/math10214055
Abstract
Solving variational image segmentation problems with hidden physics is often expensive and requires different algorithms and manually tunes model parameter. The deep learning methods based on the U-Net structure have obtained outstanding performances in many different medical image segmentation tasks, but designing such networks requires a lot of parameters and training data, not always available for practical problems. In this paper, inspired by traditional multi-phase convexity Mumford-Shah variational model and full approximation scheme (FAS) solving the nonlinear systems, we propose a novel variational-model-informed network (denoted as FAS-Unet) that exploits the model and algorithm priors to extract the multi-scale features. The proposed model-informed network integrates image data and mathematical models, and implements them through learning a few convolution kernels. Based on the variational theory and FAS algorithm, we first design a feature extraction sub-network (FAS-Solution module) to solve the model-driven nonlinear systems, where a skip-connection is employed to fuse the multi-scale features. Secondly, we further design a convolution block to fuse the extracted features from the previous stage, resulting in the final segmentation possibility. Experimental results on three different medical image segmentation tasks show that the proposed FAS-Unet is very competitive with other state-of-the-art methods in qualitative, quantitative and model complexity evaluations. Moreover, it may also be possible to train specialized network architectures that automatically satisfy some of the mathematical and physical laws in other image problems for better accuracy, faster training and improved generalization.The code is available at \url{https://github.com/zhuhui100/FASUNet}.
arXiv comment18 pages
References in corpus (15)
- A Survey on Deep Learning in Medical Image Analysis
- Automated Design of Deep Learning Methods for Biomedical Image Segmentation
- CE-Net: Context Encoder Network for 2D Medical Image Segmentation
- LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentation
- Deep learning for cardiac image segmentation: A review
- CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentation
- CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation
- Deep Learning in Medical Image Registration: A Review
- FractalNet: Ultra-Deep Neural Networks without Residuals
- AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy
- Medical Image Registration Using Deep Neural Networks: A Comprehensive Review
- MgNet: A Unified Framework of Multigrid and Convolutional Neural Network
- RatLesNetv2: A Fully Convolutional Network for Rodent Brain Lesion Segmentation
- RSANet: Recurrent Slice-wise Attention Network for Multiple Sclerosis Lesion Segmentation
- KiU-Net: Towards Accurate Segmentation of Biomedical Images using Over-complete Representations