Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Future

Abstract

In this article, we perform a review of the state-of-the-art of hybrid machine learning in medical imaging. We start with a short summary of the general developments of the past in machine learning and how general and specialized approaches have been in competition in the past decades. A particular focus will be the theoretical and experimental evidence pro and contra hybrid modelling. Next, we inspect several new developments regarding hybrid machine learning with a particular focus on so-called known operator learning and how hybrid approaches gain more and more momentum across essentially all applications in medical imaging and medical image analysis. As we will point out by numerous examples, hybrid models are taking over in image reconstruction and analysis. Even domains such as physical simulation and scanner and acquisition design are being addressed using machine learning grey box modelling approaches. Towards the end of the article, we will investigate a few future directions and point out relevant areas in which hybrid modelling, meta learning, and other domains will likely be able to drive the state-of-the-art ahead.

arXiv comment22 pages, 4 figures, submitted to "Progress in Biomedical Engineering"

References in corpus (36)

• A Survey on Deep Learning in Medical Image Analysis
• TensorFlow: A system for large-scale machine learning
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Neural Architecture Search with Reinforcement Learning
• VoxelMorph: A Learning Framework for Deformable Medical Image Registration
• Image reconstruction by domain transform manifold learning
• Learned Primal-dual Reconstruction
• Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method
• Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
• Deep Learning: A Critical Appraisal
• Distribution Matching Losses Can Hallucinate Features in Medical Image Translation
• The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence
• nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation
• Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics
• Learning with Known Operators reduces Maximum Training Error Bounds
• Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers
• Tensor Networks in a Nutshell
• Deep Null Space Learning for Inverse Problems: Convergence Analysis and Rates
• SYSTRAN's Pure Neural Machine Translation Systems
• PYRO-NN: Python Reconstruction Operators in Neural Networks
• RenderNet: A deep convolutional network for differentiable rendering from 3D shapes
• MRzero -- Fully automated discovery of MRI sequences using supervised learning
• Will we ever have Conscious Machines?
• Approximation and Estimation for High-Dimensional Deep Learning Networks
• TorchRadon: Fast Differentiable Routines for Computed Tomography
• Learning Symbolic Physics with Graph Networks
• Meta-Learning Symmetries by Reparameterization
• HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learning
• Image Reconstruction via Variational Network for Real-Time Hand-Held Sound-Speed Imaging
• MRI Image Reconstruction via Learning Optimization Using Neural ODEs
• Pruned Neural Networks are Surprisingly Modular
• Towards Fast Biomechanical Modeling of Soft Tissue Using Neural Networks
• Deriving Neural Network Architectures using Precision Learning: Parallel-to-fan beam Conversion
• Dynamical Phases and Resonance Phenomena in Information-Processing Recurrent Neural Networks
• Lesson Learnt: Modularization of Deep Networks Allow Cross-Modality Reuse

Cited by in corpus (2)

• A Scoping Review of Machine Learning Applications in Power System Protection and Disturbance Management
• Neural Integral Equations