BERTQA -- Attention on Steroids

Ankit Chadha, Rewa Sood

In this work, we extend the Bidirectional Encoder Representations from Transformers (BERT) with an emphasis on directed coattention to obtain an improved F1 performance on the SQUA…