CoVA: Context-aware Visual Attention for Webpage Information Extraction
arXiv:2110.12320 · doi:10.18653/v1/2022.ecnlp-1.11
Abstract
Webpage information extraction (WIE) is an important step to create knowledge bases. For this, classical WIE methods leverage the Document Object Model (DOM) tree of a website. However, use of the DOM tree poses significant challenges as context and appearance are encoded in an abstract manner. To address this challenge we propose to reformulate WIE as a context-aware Webpage Object Detection task. Specifically, we develop a Context-aware Visual Attention-based (CoVA) detection pipeline which combines appearance features with syntactical structure from the DOM tree. To study the approach we collect a new large-scale dataset of e-commerce websites for which we manually annotate every web element with four labels: product price, product title, product image and background. On this dataset we show that the proposed CoVA approach is a new challenging baseline which improves upon prior state-of-the-art methods.
11 Pages, 6 Figures, 3 Tables
References in corpus (7)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Semi-Supervised Classification with Graph Convolutional Networks
- A Structured Self-attentive Sentence Embedding
- One-Shot Object Detection with Co-Attention and Co-Excitation
- Spatial Dependency Parsing for Semi-Structured Document Information Extraction
- Simplified DOM Trees for Transferable Attribute Extraction from the Web
- Attention-based Joint Detection of Object and Semantic Part