Dynamic ordering in sequence generation in Transformers: experiments on low-resource Tagging scenarios

Giacomo Bais, Tejaswini Deoskar

This paper introduces TagInsert, a Transformer-based model that challenges the common left-to-right (L2R) generation paradigm in Transformers, for sequence labelling tasks where de…