Detecting Curve Text in the Wild: New Dataset and New Solution
arXiv:1712.02170
Abstract
Scene text detection has been made great progress in recent years. The detection manners are evolving from axis-aligned rectangle to rotated rectangle and further to quadrangle. However, current datasets contain very little curve text, which can be widely observed in scene images such as signboard, product name and so on. To raise the concerns of reading curve text in the wild, in this paper, we construct a curve text dataset named CTW1500, which includes over 10k text annotations in 1,500 images (1000 for training and 500 for testing). Based on this dataset, we pioneering propose a polygon based curve text detector (CTD) which can directly detect curve text without empirical combination. Moreover, by seamlessly integrating the recurrent transverse and longitudinal offset connection (TLOC), the proposed method can be end-to-end trainable to learn the inherent connection among the position offsets. This allows the CTD to explore context information instead of predicting points independently, resulting in more smooth and accurate detection. We also propose two simple but effective post-processing methods named non-polygon suppress (NPS) and polygonal non-maximum suppression (PNMS) to further improve the detection accuracy. Furthermore, the proposed approach in this paper is designed in an universal manner, which can also be trained with rectangular or quadrilateral bounding boxes without extra efforts. Experimental results on CTW-1500 demonstrate our method with only a light backbone can outperform state-of-the-art methods with a large margin. By evaluating only in the curve or non-curve subset, the CTD + TLOC can still achieve the best results. Code is available at https://github.com/Yuliang-Liu/Curve-Text-Detector.
arXiv comment9 pages
References in corpus (3)
Cited by in corpus (48)
- TextField: Learning A Deep Direction Field for Irregular Scene Text Detection
- Scene Text Detection and Recognition: The Deep Learning Era
- A Single-Shot Arbitrarily-Shaped Text Detector based on Context Attended Multi-Task Learning
- Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network
- Character Region Awareness for Text Detection
- Pyramid Mask Text Detector
- MTRNet: A Generic Scene Text Eraser
- Text Recognition in the Wild: A Survey
- Shape Robust Text Detection with Progressive Scale Expansion Network
- TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes
- ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)
- A Survey of Deep Learning Approaches for OCR and Document Understanding
- Text Detection and Recognition in the Wild: A Review
- PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Text
- ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detection
- Look More Than Once: An Accurate Detector for Text of Arbitrary Shapes
- CentripetalText: An Efficient Text Instance Representation for Scene Text Detection
- Arbitrary-Shaped Text Detection withAdaptive Text Region Representation
- Omnidirectional Scene Text Detection with Sequential-free Box Discretization
- ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVT
- MSR: Multi-Scale Shape Regression for Scene Text Detection
- A Multi-Object Rectified Attention Network for Scene Text Recognition
- Mask R-CNN with Pyramid Attention Network for Scene Text Detection
- Open Images V5 Text Annotation and Yet Another Mask Text Spotter
- FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representation
- Chinese Street View Text: Large-scale Chinese Text Reading with Partially Supervised Learning
- PuzzleNet: Scene Text Detection by Segment Context Graph Learning
- SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worlds
- TextCohesion: Detecting Text for Arbitrary Shapes
- Curved Text Detection in Natural Scene Images with Semi- and Weakly-Supervised Learning
- Weakly-Supervised Arbitrary-Shaped Text Detection with Expectation-Maximization Algorithm
- A New Unified Method for Detecting Text from Marathon Runners and Sports Players in Video
- RSCA: Real-time Segmentation-based Context-Aware Scene Text Detection
- ARTS: Eliminating Inconsistency between Text Detection and Recognition with Auto-Rectification Text Spotter
- Scene Text Detection with Scribble Lines
- TextTubes for Detecting Curved Text in the Wild
- Detecting Curve Text with Local Segmentation Network and Curve Connection
- MT: Multi-Perspective Feature Learning Network for Scene Text Detection
- On Exploring and Improving Robustness of Scene Text Detection Models
- NENET: An Edge Learnable Network for Link Prediction in Scene Text
- A Multiplexed Network for End-to-End, Multilingual OCR
- All you need is a second look: Towards Tighter Arbitrary shape text detection
- ICDAR 2021 Competition on Scene Video Text Spotting
- Bidirectional Regression for Arbitrary-Shaped Text Detection
- A method for detecting text of arbitrary shapes in natural scenes that improves text spotting
- All You Need is a Second Look: Towards Arbitrary-Shaped Text Detection
- Adaptive Shrink-Mask for Text Detection
- Conceptual Text Region Network: Cognition-Inspired Accurate Scene Text Detection