Metadata Shaping: Natural Language Annotations for the Tail

Simran Arora, Sen Wu, Enci Liu +1

Language models (LMs) have made remarkable progress, but still struggle to generalize beyond the training data to rare linguistic patterns. Since rare entities and facts are preval…