Visualizing and Measuring the Geometry of BERT

Andy Coenen, Emily Reif, Ann Yuan +4

Transformer architectures show significant promise for natural language processing. Given that a single pretrained model can be fine-tuned to perform well on many different tasks,…