Transformer Uncertainty Estimation with Hierarchical Stochastic Attention

Jiahuan Pei, Cheng Wang, György Szarvas

Transformers are state-of-the-art in a wide range of NLP tasks and have also been applied to many real-world products. Understanding the reliability and certainty of transformer mo…