18 citations · 38 across the 10 of their papers we have counts for
4 papers · 1 filter
Arctic-TILT. Business Document Understanding at Sub-Billion Scale
Łukasz Borchmann, Michał Pietruszka, Wojciech Jaśkowski +13
The vast portion of workloads employing LLMs involves answering questions grounded on PDF or scan content. We introduce the Arctic-TILT achieving accuracy on par with models 1000$\…
STable: Table Generation Framework for Encoder-Decoder Models
Michał Pietruszka, Michał Turski, Łukasz Borchmann +5
The output structure of database-like tables, consisting of values structured in horizontal rows and vertical columns identifiable by name, can cover a wide range of NLP tasks. Fol…
Sparsifying Transformer Models with Trainable Representation Pooling
Michał Pietruszka, Łukasz Borchmann, Łukasz Garncarek
We propose a novel method to sparsify attention in the Transformer model by learning to select the most-informative token representations during the training process, thus focusing…
LAMBERT: Layout-Aware (Language) Modeling for information extraction
Łukasz Garncarek, Rafał Powalski, Tomasz Stanisławek +4
We introduce a simple new approach to the problem of understanding documents where non-trivial layout influences the local semantics. To this end, we modify the Transformer encoder…