T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging

Abstract

Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have significantly improved the performance over conventional methods. However, most state-of-the-art deep learning methods require the manual design of multiple network components and training strategies. In this paper, we propose a new automated machine learning algorithm, T-AutoML, which not only searches for the best neural architecture, but also finds the best combination of hyper-parameters and data augmentation strategies simultaneously. The proposed method utilizes the modern transformer model, which is introduced to adapt to the dynamic length of the search space embedding and can significantly improve the ability of the search. We validate T-AutoML on several large-scale public lesion segmentation data-sets and achieve state-of-the-art performance.

Accepted at ICCV 2021

References in corpus (15)

• Neural Architecture Search with Reinforcement Learning
• Neural Architecture Search: A Survey
• DARTS: Differentiable Architecture Search
• The Liver Tumor Segmentation Benchmark (LiTS)
• Efficient Neural Architecture Search via Parameter Sharing
• RA-UNet: A hybrid deep attention-aware network to extract liver and tumor in CT scans
• Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
• Single Path One-Shot Neural Architecture Search with Uniform Sampling
• Neural Optimizer Search with Reinforcement Learning
• Scalable Neural Architecture Search for 3D Medical Image Segmentation
• Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks
• Exploring Randomly Wired Neural Networks for Image Recognition
• AutoLoss: Learning Discrete Schedules for Alternate Optimization
• APQ: Joint Search for Network Architecture, Pruning and Quantization Policy
• Learning to Rank Learning Curves