TextBoxes++: A Single-Shot Oriented Scene Text Detector
arXiv:1801.02765 · doi:10.1109/TIP.2018.2825107
Abstract
Scene text detection is an important step of scene text recognition system and also a challenging problem. Different from general object detection, the main challenges of scene text detection lie on arbitrary orientations, small sizes, and significantly variant aspect ratios of text in natural images. In this paper, we present an end-to-end trainable fast scene text detector, named TextBoxes++, which detects arbitrary-oriented scene text with both high accuracy and efficiency in a single network forward pass. No post-processing other than an efficient non-maximum suppression is involved. We have evaluated the proposed TextBoxes++ on four public datasets. In all experiments, TextBoxes++ outperforms competing methods in terms of text localization accuracy and runtime. More specifically, TextBoxes++ achieves an f-measure of 0.817 at 11.6fps for 1024*1024 ICDAR 2015 Incidental text images, and an f-measure of 0.5591 at 19.8fps for 768*768 COCO-Text images. Furthermore, combined with a text recognizer, TextBoxes++ significantly outperforms the state-of-the-art approaches for word spotting and end-to-end text recognition tasks on popular benchmarks. Code is available at: https://github.com/MhLiao/TextBoxes_plusplus
15 pages
References in corpus (5)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection
- TextBoxes: A Fast Text Detector with a Single Deep Neural Network
- Scene Text Detection via Holistic, Multi-Channel Prediction
- PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection
Cited by in corpus (102)
- Gliding vertex on the horizontal bounding box for multi-oriented object detection
- Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
- MMRotate: A Rotated Object Detection Benchmark using PyTorch
- Deep Learning for UAV-based Object Detection and Tracking: A Survey
- TextField: Learning A Deep Direction Field for Irregular Scene Text Detection
- Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
- VSSA-NET: Vertical Spatial Sequence Attention Network for Traffic Sign Detection
- R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
- A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detection
- Optimization for Arbitrary-Oriented Object Detection via Representation Invariance Loss
- Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
- Scene Text Detection and Recognition: The Deep Learning Era
- PolarDet: A Fast, More Precise Detector for Rotated Target in Aerial Images
- Adaptive Period Embedding for Representing Oriented Objects in Aerial Images
- IENet: Interacting Embranchment One Stage Anchor Free Detector for Orientation Aerial Object Detection
- Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network
- Gaussian Bounding Boxes and Probabilistic Intersection-over-Union for Object Detection
- Learning Modulated Loss for Rotated Object Detection
- Character Region Awareness for Text Detection
- Industrial Scene Text Detection with Refined Feature-attentive Network
- Pyramid Mask Text Detector
- Text Recognition in the Wild: A Survey
- Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
- Scene Text Recognition from Two-Dimensional Perspective
- CT-Net: Arbitrary-Shaped Text Detection via Contour Transformer
- TextDCT: Arbitrary-Shaped Text Detection via Discrete Cosine Transform Mask
- Text Detection and Recognition in the Wild: A Review
- A Survey of Deep Learning Approaches for OCR and Document Understanding
- Fourier Contour Embedding for Arbitrary-Shaped Text Detection
- PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Text
- Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detection
- ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting
- Linear Gaussian Bounding Box Representation and Ring-Shaped Rotated Convolution for Oriented Object Detection
- Anchor Pruning for Object Detection
- Rotation-Sensitive Regression for Oriented Scene Text Detection
- CBNet: A Plug-and-Play Network for Segmentation-Based Scene Text Detection
- Dense Label Encoding for Boundary Discontinuity Free Rotation Detection
- TextMountain: Accurate Scene Text Detection via Instance Segmentation
- CentripetalText: An Efficient Text Instance Representation for Scene Text Detection
- Video Text Tracking With a Spatio-Temporal Complementary Model
- Arbitrary-Shaped Text Detection withAdaptive Text Region Representation
- Anchor Box Optimization for Object Detection
- Omnidirectional Scene Text Detection with Sequential-free Box Discretization
- MRZ code extraction from visa and passport documents using convolutional neural networks
- Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation
- ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVT
- MSR: Multi-Scale Shape Regression for Scene Text Detection
- An End-to-End Network for Co-Saliency Detection in One Single Image
- Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting
- Open Images V5 Text Annotation and Yet Another Mask Text Spotter
- Towards End-to-End Text Spotting in Natural Scenes
- FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representation
- Chinese Street View Text: Large-scale Chinese Text Reading with Partially Supervised Learning
- FC2RN: A Fully Convolutional Corner Refinement Network for Accurate Multi-Oriented Scene Text Detection
- What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labels
- SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worlds
- Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images
- TextCohesion: Detecting Text for Arbitrary Shapes
- Neural Word Search in Historical Manuscript Collections
- All You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting
- Universal Defensive Underpainting Patch: Making Your Text Invisible to Optical Character Recognition
- Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting
- RRPN++: Guidance Towards More Accurate Scene Text Detection
- ShopSign: a Diverse Scene Text Dataset of Chinese Shop Signs in Street Views
- MOST: A Multi-Oriented Scene Text Detector with Localization Refinement
- Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text Detection
- Exploring the Capacity of an Orderless Box Discretization Network for Multi-orientation Scene Text Detection
- Arbitrarily Shaped Scene Text Detection: A Decade of Advances and Systematic Analysis
- TextNet: Irregular Text Reading from Images with an End-to-End Trainable Network
- Character Region Attention For Text Spotting
- PBFormer: Capturing Complex Scene Text Shape with Polynomial Band Transformer
- RSCA: Real-time Segmentation-based Context-Aware Scene Text Detection
- Learning Robust Feature Representations for Scene Text Detection
- A Feasible Framework for Arbitrary-Shaped Scene Text Recognition
- TextTubes for Detecting Curved Text in the Wild
- Scene Text Detection with Selected Anchor
- Which and Where to Focus: A Simple yet Accurate Framework for Arbitrary-Shaped Nearby Text Detection in Scene Images
- NENET: An Edge Learnable Network for Link Prediction in Scene Text
- MT: Multi-Perspective Feature Learning Network for Scene Text Detection
- Single Shot Scene Text Retrieval
- Ladder Bottom-up Convolutional Bidirectional Variational Autoencoder for Image Translation of Dotted Arabic Expiration Dates
- An Artificial Intelligence System for Combined Fruit Detection and Georeferencing, Using RTK-Based Perspective Projection in Drone Imagery
- DrawMon: A Distributed System for Detection of Atypical Sketch Content in Concurrent Pictionary Games
- AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting
- Edge Learning with Unmanned Ground Vehicle: Joint Path, Energy and Sample Size Planning
- Towards Pure End-to-End Learning for Recognizing Multiple Text Sequences from an Image
- All you need is a second look: Towards Tighter Arbitrary shape text detection
- Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection
- Efficient Scene Text Detection with Textual Attention Tower
- Conceptual Text Region Network: Cognition-Inspired Accurate Scene Text Detection
- Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding
- Context-Free TextSpotter for Real-Time and Mobile End-to-End Text Detection and Recognition
- TextContourNet: a Flexible and Effective Framework for Improving Scene Text Detection Architecture with a Multi-task Cascade
- Predictive Ensemble Learning with Application to Scene Text Detection
- A DCNN-based Arbitrarily-Oriented Object Detector for Quality Control and Inspection Application
- OSKDet: Towards Orientation-sensitive Keypoint Localization for Rotated Object Detection
- Research on All-content Text Recognition Method for Financial Ticket Image
- CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks
- Semi-Bagging Based Deep Neural Architecture to Extract Text from High Entropy Images
- All You Need is a Second Look: Towards Arbitrary-Shaped Text Detection
- Bidirectional Regression for Arbitrary-Shaped Text Detection
- A Multi-oriented Chinese Keyword Spotter Guided by Text Line Detection