Advances of Transformer-Based Models for News Headline Generation

Alexey Bukhtiyarov, Ilya Gusev

Pretrained language models based on Transformer architecture are the reason for recent breakthroughs in many areas of NLP, including sentiment analysis, question answering, named e…