The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues

Allison Hegel, Marina Shah, Genevieve Peaslee +2

Large, pre-trained transformer models like BERT have achieved state-of-the-art results on document understanding tasks, but most implementations can only consider 512 tokens at a t…