Can Unconditional Language Models Recover Arbitrary Sentences?

Nishant Subramani, Samuel R. Bowman, Kyunghyun Cho

Neural network-based generative language models like ELMo and BERT can work effectively as general purpose sentence encoders in text classification without further fine-tuning. Is…