TED-net: Convolution-free T2T Vision Transformer-based Encoder-decoder Dilation network for Low-dose CT Denoising
arXiv:2106.04650
Abstract
Low dose computed tomography is a mainstream for clinical applications. How-ever, compared to normal dose CT, in the low dose CT (LDCT) images, there are stronger noise and more artifacts which are obstacles for practical applications. In the last few years, convolution-based end-to-end deep learning methods have been widely used for LDCT image denoising. Recently, transformer has shown superior performance over convolution with more feature interactions. Yet its ap-plications in LDCT denoising have not been fully cultivated. Here, we propose a convolution-free T2T vision transformer-based Encoder-decoder Dilation net-work (TED-net) to enrich the family of LDCT denoising algorithms. The model is free of convolution blocks and consists of a symmetric encoder-decoder block with sole transformer. Our model is evaluated on the AAPM-Mayo clinic LDCT Grand Challenge dataset, and results show outperformance over the state-of-the-art denoising methods.
arXiv comment10 pages, manuscript for 12th International Workshop on Machine Learning in Medical Imaging
References in corpus (13)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Language Models are Few-Shot Learners
- Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)
- Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
- Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation
- Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?
- GPU-based Low Dose CT Reconstruction via Edge-preserving Total Variation Regularization
- CvT: Introducing Convolutions to Vision Transformers
- Pre-Trained Image Processing Transformer
- Rethinking Attention with Performers
- DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
- HOTR: End-to-End Human-Object Interaction Detection with Transformers
- TransCT: Dual-path Transformer for Low Dose Computed Tomography