189 citations · 313 across the 8 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2020
Contextual BERT: Conditioning the Language Model Using a Global State
Timo I. Denk, Ana Peleteiro Ramallo
BERT is a popular language model whose main pre-training task is to fill in the blank, i.e., predicting a word that was masked out of a sentence, based on the remaining words. In s…
cs.CL2019★ 69 cited
BERTgrid: Contextualized Embedding for 2D Document Representation and Understanding
Timo I. Denk, Christian Reisswig
For understanding generic documents, information like font sizes, column layout, and generally the positioning of words may carry semantic information that is crucial for solving a…