Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks

Yichen Huang, Timothy Baldwin

We investigate MT evaluation metric performance on adversarially-synthesized texts, to shed light on metric robustness. We experiment with word- and character-level attacks on thre…