Improving Question Answering Performance Using Knowledge Distillation and Active Learning

Yasaman Boreshban, Seyed Morteza Mirbostani, Gholamreza Ghassem-Sani +2

Contemporary question answering (QA) systems, including transformer-based architectures, suffer from increasing computational and model complexity which render them inefficient for…