Build a Robust QA System with Transformer-based Mixture of Experts

Yu Qing Zhou, Xixuan Julie Liu, Yuanzhe Dong

In this paper, we aim to build a robust question answering system that can adapt to out-of-domain datasets. A single network may overfit to the superficial correlation in the train…