Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation

Francois Meyer, Jan Buys

Subword segmenters like BPE operate as a preprocessing step in neural machine translation and other (conditional) language models. They are applied to datasets before training, so…