Robust Text Detection in Natural Scene Images
arXiv:1301.2628 · doi:10.1109/TPAMI.2013.182
Abstract
Text detection in natural scene images is an important prerequisite for many content-based image analysis tasks. In this paper, we propose an accurate and robust method for detecting texts in natural scene images. A fast and effective pruning algorithm is designed to extract Maximally Stable Extremal Regions (MSERs) as character candidates using the strategy of minimizing regularized variations. Character candidates are grouped into text candidates by the ingle-link clustering algorithm, where distance weights and threshold of the clustering algorithm are learned automatically by a novel self-training distance metric learning algorithm. The posterior probabilities of text candidates corresponding to non-text are estimated with an character classifier; text candidates with high probabilities are then eliminated and finally texts are identified with a text classifier. The proposed system is evaluated on the ICDAR 2011 Robust Reading Competition dataset; the f measure is over 76% and is significantly better than the state-of-the-art performance of 71%. Experimental results on a publicly available multilingual dataset also show that our proposed method can outperform the other competitive method with the f measure increase of over 9 percent. Finally, we have setup an online demo of our proposed scene text detection system at http://kems.ustb.edu.cn/learning/yin/dtext.
A Draft Version (Submitted to IEEE TPAMI)
Cited by in corpus (49)
- Arbitrary-Oriented Scene Text Detection via Rotation Proposals
- Object Detection in 20 Years: A Survey
- R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection
- Text-Attentional Convolutional Neural Networks for Scene Text Detection
- Scene Text Detection via Holistic, Multi-Channel Prediction
- EAST: An Efficient and Accurate Scene Text Detector
- Scene Text Detection and Recognition: The Deep Learning Era
- DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images
- Multi-Oriented Text Detection with Fully Convolutional Networks
- Accurate Text Localization in Natural Image with Cascaded Convolutional Text Network
- Single Shot Text Detector with Regional Attention
- Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
- Industrial Scene Text Detection with Refined Feature-attentive Network
- Multi-Oriented Text Detection and Verification in Video Frames and Scene Images
- WordSup: Exploiting Word Annotations for Character based Text Detection
- Detecting Multi-Oriented Text with Corner-based Region Proposals
- Reading Scene Text in Deep Convolutional Sequences
- TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes
- An end-to-end TextSpotter with Explicit Alignment and Attention
- Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networks
- Text Detection and Recognition in the Wild: A Review
- End-to-End Subtitle Detection and Recognition for Videos in East Asian Languages via CNN Ensemble with Near-Human-Level Performance
- ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detection
- A pooling based scene text proposal technique for scene text reading in the wild
- Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detection
- ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting
- Improving Text Proposals for Scene Images with Fully Convolutional Networks
- TextProposals: a Text-specific Selective Search Algorithm for Word Spotting in the Wild
- WeText: Scene Text Detection under Weak Supervision
- Video Text Tracking With a Spatio-Temporal Complementary Model
- Detecting Oriented Text in Natural Images by Linking Segments
- Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation
- FOTS: Fast Oriented Text Spotting with a Unified Network
- Towards End-to-End Text Spotting in Natural Scenes
- ArbiText: Arbitrary-Oriented Text Detection in Unconstrained Scene
- You Only Recognize Once: Towards Fast Video Text Spotting
- TextCohesion: Detecting Text for Arbitrary Shapes
- Efficient Scene Text Localization and Recognition with Local Character Refinement
- ReLaText: Exploiting Visual Relationships for Arbitrary-Shaped Scene Text Detection with Graph Convolutional Networks
- Cascaded Segmentation-Detection Networks for Word-Level Text Spotting
- An End-to-end Video Text Detector with Online Tracking
- A Fast Hierarchical Method for Multi-script and Arbitrary Oriented Scene Text Extraction
- Deep Residual Text Detection Network for Scene Text
- TextTubes for Detecting Curved Text in the Wild
- RFBTD: RFB Text Detector
- Text Flow: A Unified Text Detection System in Natural Scene Images
- Character Proposal Network for Robust Text Extraction
- A Multiplexed Network for End-to-End, Multilingual OCR
- Conceptual Text Region Network: Cognition-Inspired Accurate Scene Text Detection