Multi-modal Deep Guided Filtering for Comprehensible Medical Image Processing

Abstract

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive issue. The integration of known operators into the deep learning environment has proven to be advantageous for the comprehensibility and reliability of the computations. Consequently, we propose the use of the locally linear guided filter in combination with a learned guidance map for general purpose medical image processing. The output images are only processed by the guided filter while the guidance map can be trained to be task-optimal in an end-to-end fashion. We investigate the performance based on two popular tasks: image super resolution and denoising. The evaluation is conducted based on pairs of multi-modal magnetic resonance imaging and cross-modal computed tomography and magnetic resonance imaging datasets. For both tasks, the proposed approach is on par with state-of-the-art approaches. Additionally, we can show that the input image's content is almost unchanged after the processing which is not the case for conventional deep learning approaches. On top, the proposed pipeline offers increased robustness against degraded input as well as adversarial attacks.

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Understanding Black-box Predictions via Influence Functions
• On instabilities of deep learning in image reconstruction - Does AI come at a cost?
• Opening the Black Box of Deep Neural Networks via Information
• Learned Primal-dual Reconstruction
• Medical image denoising using convolutional denoising autoencoders
• Wide Activation for Efficient and Accurate Image Super-Resolution
• Adversarial Examples: Attacks and Defenses for Deep Learning
• Learning with Known Operators reduces Maximum Training Error Bounds
• MR to X-Ray Projection Image Synthesis
• Deriving Neural Network Architectures using Precision Learning: Parallel-to-fan beam Conversion

Cited by in corpus (1)

• Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges