Table-To-Text generation and pre-training with TabT5

Ewa Andrejczuk, Julian Martin Eisenschlos, Francesco Piccinno +2

Encoder-only transformer models have been successfully applied to different table understanding tasks, as in TAPAS (Herzig et al., 2020). A major limitation of these architectures…