Coherence boosting: When your pretrained language model is not paying enough attention

Nikolay Malkin, Zhen Wang, Nebojsa Jojic

Long-range semantic coherence remains a challenge in automatic language generation and understanding. We demonstrate that large language models have insufficiently learned the effe…