WordFence: Text Detection in Natural Images with Border Awareness
arXiv:1705.05483
Abstract
In recent years, text recognition has achieved remarkable success in recognizing scanned document text. However, word recognition in natural images is still an open problem, which generally requires time consuming post-processing steps. We present a novel architecture for individual word detection in scene images based on semantic segmentation. Our contributions are twofold: the concept of WordFence, which detects border areas surrounding each individual word and a novel pixelwise weighted softmax loss function which penalizes background and emphasizes small text regions. WordFence ensures that each word is detected individually, and the new loss function provides a strong training signal to both text and word border localization. The proposed technique avoids intensive post-processing, producing an end-to-end word detection system. We achieve superior localization recall on common benchmark datasets - 92% recall on ICDAR11 and ICDAR13 and 63% recall on SVT. Furthermore, our end-to-end word recognition system achieves state-of-the-art 86% F-Score on ICDAR13.
arXiv comment5 pages, 2 figures, ICIP 2017
References in corpus (9)
- R-FCN: Object Detection via Region-based Fully Convolutional Networks
- Multi-Scale Context Aggregation by Dilated Convolutions
- OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
- Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
- COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Images
- Synthetic Data for Text Localisation in Natural Images
- DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images
- Multi-Oriented Text Detection with Fully Convolutional Networks
- Accurate Text Localization in Natural Image with Cascaded Convolutional Text Network