PAGnol: An Extra-Large French Generative Model

Julien Launay, Elena Tommasone, Baptiste Pannier +5

Access to large pre-trained models of varied architectures, in many different languages, is central to the democratization of NLP. We introduce PAGnol, a collection of French GPT m…