Ad Headline Generation using Self-Critical Masked Language Model

Abstract

For any E-commerce website it is a nontrivial problem to build enduring advertisements that attract shoppers. It is hard to pass the creative quality bar of the website, especially at a large scale. We thus propose a programmatic solution to generate product advertising headlines using retail content. We propose a state of the art application of Reinforcement Learning (RL) Policy gradient methods on Transformer based Masked Language Models. Our method creates the advertising headline by jointly conditioning on multiple products that a seller wishes to advertise. We demonstrate that our method outperforms existing Transformer and LSTM + RL methods in overlap metrics and quality audits. We also show that our model-generated headlines outperform human submitted headlines in terms of both grammar and creative quality as determined by audits.

Accepted at NAACL-HLT 2021 (Industry Track). 9 pages, 3 tables, 3 figures - ACL Anthology URL: https://aclanthology.org/2021.naacl-industry.33/ - Editors of the proceedings: Young-bum Kim, Yunyao Li, Owen Rambow - Bibkey: kanungo-etal-2021-ad

References in corpus (8)

• Adam: A Method for Stochastic Optimization
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• Unified Language Model Pre-training for Natural Language Understanding and Generation
• Sequence Level Training with Recurrent Neural Networks
• An Actor-Critic Algorithm for Sequence Prediction
• Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
• Incorporating BERT into Neural Machine Translation

Cited by in corpus (2)

• When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities
• Toward Improving Coherence and Diversity of Slogan Generation