BERTGEN: Multi-task Generation through BERT

Faidon Mitzalis, Ozan Caglayan, Pranava Madhyastha +1

We present BERTGEN, a novel generative, decoder-only model which extends BERT by fusing multimodal and multilingual pretrained models VL-BERT and M-BERT, respectively. BERTGEN is a…