Fast object detection in compressed JPEG Images

Abstract

Object detection in still images has drawn a lot of attention over past few years, and with the advent of Deep Learning impressive performances have been achieved with numerous industrial applications. Most of these deep learning models rely on RGB images to localize and identify objects in the image. However in some application scenarii, images are compressed either for storage savings or fast transmission. Therefore a time consuming image decompression step is compulsory in order to apply the aforementioned deep models. To alleviate this drawback, we propose a fast deep architecture for object detection in JPEG images, one of the most widespread compression format. We train a neural network to detect objects based on the blockwise DCT (discrete cosine transform) coefficients {issued from} the JPEG compression algorithm. We modify the well-known Single Shot multibox Detector (SSD) by replacing its first layers with one convolutional layer dedicated to process the DCT inputs. Experimental evaluations on PASCAL VOC and industrial dataset comprising images of road traffic surveillance show that the model is about $2\times$ faster than regular SSD with promising detection performances. To the best of our knowledge, this paper is the first to address detection in compressed JPEG images.

References in corpus (12)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• YOLOv3: An Incremental Improvement
• R-FCN: Object Detection via Region-based Fully Convolutional Networks
• Rich feature hierarchies for accurate object detection and semantic segmentation
• YOLO9000: Better, Faster, Stronger
• FSSD: Feature Fusion Single Shot Multibox Detector
• Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
• Towards Image Understanding from Deep Compression without Decoding
• Fast Object Detection in Compressed Video
• Harmonic Networks: Integrating Spectral Information into CNNs

Cited by in corpus (4)

• Less is More: Accelerating Faster Neural Networks Straight from JPEG
• All-in-One Image Compression and Restoration
• Exploring Semantic Segmentation on the DCT Representation
• Intelligent Video Recording Optimization using Activity Detection for Surveillance Systems