Illicit object detection in X-ray images using Vision Transformers

Abstract

Illicit object detection is a critical task performed at various high-security locations, including airports, train stations, subways, and ports. The continuous and tedious work of examining thousands of X-ray images per hour can be mentally taxing. Thus, Deep Neural Networks (DNNs) can be used to automate the X-ray image analysis process, improve efficiency and alleviate the security officers' inspection burden. The neural architectures typically utilized in relevant literature are Convolutional Neural Networks (CNNs), with Vision Transformers (ViTs) rarely employed. In order to address this gap, this paper conducts a comprehensive evaluation of relevant ViT architectures on illicit item detection in X-ray images. This study utilizes both Transformer and hybrid backbones, such as SWIN and NextViT, and detectors, such as DINO and RT-DETR. The results demonstrate the remarkable accuracy of the DINO Transformer detector in the low-data regime, the impressive real-time performance of YOLOv8, and the effectiveness of the hybrid NextViT backbone.

References in corpus (8)

• SSD: Single Shot MultiBox Detector
• Decoupled Weight Decay Regularization
• DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection
• Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios
• Computer Vision on X-ray Data in Industrial Production and Security Applications: A Comprehensive Survey
• Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from X-ray Scans
• Visual inspection for illicit items in X-ray images using Deep Learning
• Self-supervised visual learning for analyzing firearms trafficking activities on the Web