123 citations · 126 across the 4 of their papers we have counts for
6 papers
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
Zeming Chen, Alejandro Hernández Cano, Angelika Romanou +17
Large language models (LLMs) can potentially democratize access to medical knowledge. While many efforts have been made to harness and improve LLMs' medical knowledge and reasoning…
Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Models
Syrielle Montariol, Arij Riabi, Djamé Seddah
Zero-shot cross-lingual transfer learning has been shown to be highly challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between la…
Capturing Evolution in Word Usage: Just Add More Clusters?
Matej Martinc, Syrielle Montariol, Elaine Zosa +1
The way the words are used evolves through time, mirroring cultural or technological evolution of society. Semantic change detection is the task of detecting and analysing word evo…
Empirical Study of Diachronic Word Embeddings for Scarce Data
Syrielle Montariol, Alexandre Allauzen
Word meaning change can be inferred from drifts of time-varying word embeddings. However, temporal data may be too sparse to build robust word embeddings and to discriminate signif…
Learning dynamic word embeddings with drift regularisation
Syrielle Montariol, Alexandre Allauzen
Word usage, meaning and connotation change throughout time. Diachronic word embeddings are used to grasp these changes in an unsupervised way. In this paper, we use variants of the…
Exploring sentence informativeness
Syrielle Montariol, Aina Garí Soler, Alexandre Allauzen
This study is a preliminary exploration of the concept of informativeness -how much information a sentence gives about a word it contains- and its potential benefits to building qu…