The advantages of context specific language models: the case of the Erasmian Language Model

João Gonçalves, Nick Jelicic, Michele Murgia +1

The current trend to improve language model performance seems to be based on scaling up with the number of parameters (e.g. the state of the art GPT4 model has approximately 1.7 tr…