SQUARE: Automatic Question Answering Evaluation using Multiple Positive and Negative References

Matteo Gabburo, Siddhant Garg, Rik Koncel Kedziorski +1

Evaluation of QA systems is very challenging and expensive, with the most reliable approach being human annotations of correctness of answers for questions. Recent works (AVA, BEM)…