2 papers
cs.CL2024
From English-Centric to Effective Bilingual: LLMs with Custom Tokenizers for Underrepresented Languages
Artur Kiulian, Anton Polishko, Mykola Khandoga +10
In this paper, we propose a model-agnostic cost-effective approach to developing bilingual base large language models (LLMs) to support English and any target language. The method…
cs.LG2024
Robust Calibration For Improved Weather Prediction Under Distributional Shift
Sankalp Gilda, Neel Bhandari, Wendy Mak +1
In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty und…