Garden-Path Traversal in GPT-2

William Jurayj, William Rudman, Carsten Eickhoff

In recent years, large-scale transformer decoders such as the GPT-x family of models have become increasingly popular. Studies examining the behavior of these models tend to focus…