Self-conditioning pre-trained language models

Xavier Suau, Luca Zappella, Nicholas Apostoloff

In this paper we aim to investigate the mechanisms that guide text generation with pre-trained Transformer-based Language Models (TLMs). Grounded on the Product of Experts formulat…