How Optimal is Greedy Decoding for Extractive Question Answering?

Or Castel, Ori Ram, Avia Efrat +1

Fine-tuned language models use greedy decoding to answer reading comprehension questions with relative success. However, this approach does not ensure that the answer is a span in…