StruBERT: Structure-aware BERT for Table Search and Matching
arXiv:2203.14278 · doi:10.1145/3485447.3511972
Abstract
A large amount of information is stored in data tables. Users can search for data tables using a keyword-based query. A table is composed primarily of data values that are organized in rows and columns providing implicit structural information. A table is usually accompanied by secondary information such as the caption, page title, etc., that form the textual information. Understanding the connection between the textual and structural information is an important yet neglected aspect in table retrieval as previous methods treat each source of information independently. In addition, users can search for data tables that are similar to an existing table, and this setting can be seen as a content-based table retrieval. In this paper, we propose StruBERT, a structure-aware BERT model that fuses the textual and structural information of a data table to produce context-aware representations for both textual and tabular content of a data table. StruBERT features are integrated in a new end-to-end neural ranking model to solve three table-related downstream tasks: keyword- and content-based table retrieval, and table similarity. We evaluate our approach using three datasets, and we demonstrate substantial improvements in terms of retrieval and classification metrics over state-of-the-art methods.
The Proceddings of The ACM Web Conference 2022
References in corpus (10)
- Convolutional Neural Network Architectures for Matching Natural Language Sentences
- A Deep Relevance Matching Model for Ad-hoc Retrieval
- End-to-End Neural Ad-hoc Ranking with Kernel Pooling
- Deeper Text Understanding for IR with Contextual Neural Language Modeling
- Multi-Stage Document Ranking with BERT
- Simple Applications of BERT for Ad Hoc Document Retrieval
- Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrieval
- Table Search Using a Deep Contextualized Language Model
- EntiTables: Smart Assistance for Entity-Focused Tables
- Semantic Labeling Using a Deep Contextualized Language Model