Syn-QA2: Evaluating False Assumptions in Long-tail Questions with Synthetic QA Datasets

Ashwin Daswani, Rohan Sawant, Najoung Kim

Sensitivity to false assumptions (or false premises) in information-seeking questions is critical for robust question-answering (QA) systems. Recent work has shown that false assum…