Deep learning languages: a key fundamental shift from probabilities to weights?

François Coste

Recent successes in language modeling, notably with deep learning methods, coincide with a shift from probabilistic to weighted representations. We raise here the question of the i…