Text Compression for Efficient Language Generation

David Gu, Peter Belcak, Roger Wattenhofer

We challenge the prevailing assumption that LLMs must rely fully on sub-word tokens for high-quality text generation. To this end, we propose the "Generative Pretrained Thoughtform…