Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting
arXiv:2002.06820
Abstract
Many approaches have recently been proposed to detect irregular scene text and achieved promising results. However, their localization results may not well satisfy the following text recognition part mainly because of two reasons: 1) recognizing arbitrary shaped text is still a challenging task, and 2) prevalent non-trainable pipeline strategies between text detection and text recognition will lead to suboptimal performances. To handle this incompatibility problem, in this paper we propose an end-to-end trainable text spotting approach named Text Perceptron. Concretely, Text Perceptron first employs an efficient segmentation-based text detector that learns the latent text reading order and boundary information. Then a novel Shape Transform Module (abbr. STM) is designed to transform the detected feature regions into regular morphologies without extra parameters. It unites text detection and the following recognition part into a whole framework, and helps the whole network achieve global optimization. Experiments show that our method achieves competitive performance on two standard text benchmarks, i.e., ICDAR 2013 and ICDAR 2015, and also obviously outperforms existing methods on irregular text benchmarks SCUT-CTW1500 and Total-Text.
arXiv commentAccepted by AAAI2020. Code is available at https://davar-lab.github.io/publication.html or https://github.com/hikopensource/DAVAR-Lab-OCR
References in corpus (13)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- TextBoxes++: A Single-Shot Oriented Scene Text Detector
- Focusing Attention: Towards Accurate Text Recognition in Natural Images
- TextBoxes: A Fast Text Detector with a Single Deep Neural Network
- TextField: Learning A Deep Direction Field for Irregular Scene Text Detection
- Synthetic Data for Text Localisation in Natural Images
- EAST: An Efficient and Accurate Scene Text Detector
- Robust Scene Text Recognition with Automatic Rectification
- Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
- TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes
- An end-to-end TextSpotter with Explicit Alignment and Attention
- Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networks
- Feature Enhancement Network: A Refined Scene Text Detector