Shape Robust Text Detection with Progressive Scale Expansion Network

Abstract

The challenges of shape robust text detection lie in two aspects: 1) most existing quadrangular bounding box based detectors are difficult to locate texts with arbitrary shapes, which are hard to be enclosed perfectly in a rectangle; 2) most pixel-wise segmentation-based detectors may not separate the text instances that are very close to each other. To address these problems, we propose a novel Progressive Scale Expansion Network (PSENet), designed as a segmentation-based detector with multiple predictions for each text instance. These predictions correspond to different `kernels' produced by shrinking the original text instance into various scales. Consequently, the final detection can be conducted through our progressive scale expansion algorithm which gradually expands the kernels with minimal scales to the text instances with maximal and complete shapes. Due to the fact that there are large geometrical margins among these minimal kernels, our method is effective to distinguish the adjacent text instances and is robust to arbitrary shapes. The state-of-the-art results on ICDAR 2015 and ICDAR 2017 MLT benchmarks further confirm the great effectiveness of PSENet. Notably, PSENet outperforms the previous best record by absolute 6.37\% on the curve text dataset SCUT-CTW1500. Code will be available in https://github.com/whai362/PSENet.

arXiv comment12 pages, 11 figures

References in corpus (6)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection
• TextBoxes: A Fast Text Detector with a Single Deep Neural Network
• Detecting Curve Text in the Wild: New Dataset and New Solution
• DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images
• Fused Text Segmentation Networks for Multi-oriented Scene Text Detection

Cited by in corpus (14)

• Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network
• Pyramid Mask Text Detector
• Pixel-Anchor: A Fast Oriented Scene Text Detector with Combined Networks
• Scene Text Detection with Supervised Pyramid Context Network
• TextMountain: Accurate Scene Text Detection via Instance Segmentation
• Look More Than Once: An Accurate Detector for Text of Arbitrary Shapes
• Geometry Normalization Networks for Accurate Scene Text Detection
• TC-OCR: TableCraft OCR for Efficient Detection & Recognition of Table Structure & Content
• TextCohesion: Detecting Text for Arbitrary Shapes
• Synthetic-to-Real Unsupervised Domain Adaptation for Scene Text Detection in the Wild
• Location-Aware Feature Selection Text Detection Network
• AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting
• Digging Deeper into CRNN Model in Chinese Text Images Recognition
• All you need is a second look: Towards Tighter Arbitrary shape text detection