289 citations · 337 across the 13 of their papers we have counts for
3 papers · 1 filter
Mellum2 Technical Report
Marko Kojic, Ivan Bondyrev, Aral de Moor +6
We present Mellum 2, an open-weight 12B-parameter Mixture-of-Experts (MoE) language model with 2.5B active parameters per token. Mellum 2 is a general-purpose language model specia…
Augmenting In-Context-Learning in LLMs via Automatic Data Labeling and Refinement
Joseph Shtok, Amit Alfassy, Foad Abo Dahood +3
It has been shown that Large Language Models' (LLMs) performance can be improved for many tasks using Chain of Thought (CoT) or In-Context Learning (ICL), which involve demonstrati…
NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoning
Eli Schwartz, Leshem Choshen, Joseph Shtok +3
Language models struggle with handling numerical data and performing arithmetic operations. We hypothesize that this limitation can be partially attributed to non-intuitive textual…