H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation

Abstract

In the field of medical image segmentation, variant models based on Convolutional Neural Networks (CNNs) and Visual Transformers (ViTs) as the base modules have been very widely developed and applied. However, CNNs are often limited in their ability to deal with long sequences of information, while the low sensitivity of ViTs to local feature information and the problem of secondary computational complexity limit their development. Recently, the emergence of state-space models (SSMs), especially 2D-selective-scan (SS2D), has had an impact on the longtime dominance of traditional CNNs and ViTs as the foundational modules of visual neural networks. In this paper, we extend the adaptability of SS2D by proposing a High-order Vision Mamba UNet (H-vmunet) for medical image segmentation. Among them, the proposed High-order 2D-selective-scan (H-SS2D) progressively reduces the introduction of redundant information during SS2D operations through higher-order interactions. In addition, the proposed Local-SS2D module improves the learning ability of local features of SS2D at each order of interaction. We conducted comparison and ablation experiments on three publicly available medical image datasets (ISIC2017, Spleen, and CVC-ClinicDB), and the results all demonstrate the strong competitiveness of H-vmunet in medical image segmentation tasks. The code is available from https://github.com/wurenkai/H-vmunet .

References in corpus (13)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Decoupled Weight Decay Regularization
• Attention U-Net: Learning Where to Look for the Pancreas
• The Medical Segmentation Decathlon
• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
• Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
• Efficiently Modeling Long Sequences with Structured State Spaces
• Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
• VMamba: Visual State Space Model
• U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation
• VM-UNet: Vision Mamba UNet for Medical Image Segmentation
• HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions
• U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation

Cited by in corpus (2)

• UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation
• Test-time generative augmentation for medical image segmentation