Language Models Are Implicitly Continuous

Samuele Marro, Davide Evangelista, X. Angelo Huang +3

Language is typically modelled with discrete sequences. However, the most successful approaches to language modelling, namely neural networks, are continuous and smooth function ap…