Extend and Explain: Interpreting Very Long Language Models

Joel Stremmel, Brian L. Hill, Jeffrey Hertzberg +3

While Transformer language models (LMs) are state-of-the-art for information extraction, long text introduces computational challenges requiring suboptimal preprocessing steps or a…