Scene Text Recognition from Two-Dimensional Perspective

Abstract

Inspired by speech recognition, recent state-of-the-art algorithms mostly consider scene text recognition as a sequence prediction problem. Though achieving excellent performance, these methods usually neglect an important fact that text in images are actually distributed in two-dimensional space. It is a nature quite different from that of speech, which is essentially a one-dimensional signal. In principle, directly compressing features of text into a one-dimensional form may lose useful information and introduce extra noise. In this paper, we approach scene text recognition from a two-dimensional perspective. A simple yet effective model, called Character Attention Fully Convolutional Network (CA-FCN), is devised for recognizing the text of arbitrary shapes. Scene text recognition is realized with a semantic segmentation network, where an attention mechanism for characters is adopted. Combined with a word formation module, CA-FCN can simultaneously recognize the script and predict the position of each character. Experiments demonstrate that the proposed algorithm outperforms previous methods on both regular and irregular text datasets. Moreover, it is proven to be more robust to imprecise localizations in the text detection phase, which are very common in practice.

arXiv commentTo appear in AAAI 2019

References in corpus (12)

• Adam: A Method for Stochastic Optimization
• TextBoxes++: A Single-Shot Oriented Scene Text Detector
• Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
• Focusing Attention: Towards Accurate Text Recognition in Natural Images
• TextBoxes: A Fast Text Detector with a Single Deep Neural Network
• Deformable Convolutional Networks
• Synthetic Data for Text Localisation in Natural Images
• Deep Structured Output Learning for Unconstrained Text Recognition
• Recursive Recurrent Nets with Attention Modeling for OCR in the Wild
• Reading Scene Text with Attention Convolutional Sequence Modeling
• Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
• Edit Probability for Scene Text Recognition

Cited by in corpus (4)

• Text Detection and Recognition in the Wild: A Review
• NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognition
• RobustScanner: Dynamically Enhancing Positional Clues for Robust Text Recognition
• Primitive Representation Learning for Scene Text Recognition