Bridging the Gap for Tokenizer-Free Language Models

Dokook Choe, Rami Al-Rfou, Mandy Guo +2

Purely character-based language models (LMs) have been lagging in quality on large scale datasets, and current state-of-the-art LMs rely on word tokenization. It has been assumed t…