5 papers · 1 filter
Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic
Zaid Alyafeai, Michael Pieler, Hannah Teufel +8
Large Language Models (LLMs) have shown impressive results in multiple domains of natural language processing (NLP) but are mainly focused on the English language. Recently, more L…
Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training
Michael Pieler, Marco Bellagente, Hannah Teufel +9
Recently published work on rephrasing natural text data for pre-training LLMs has shown promising results when combining the original dataset with the synthetically rephrased data.…
GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinements
Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis +4
State-of-the-art language models can exhibit impressive reasoning refinement capabilities on math, science or coding tasks. However, recent work demonstrates that even the best mod…
Stable Code Technical Report
Nikhil Pinnaparaju, Reshinth Adithyan, Duy Phung +8
We introduce Stable Code, the first in our new-generation of code language models series, which serves as a general-purpose base code language model targeting code completion, reas…
Stable LM 2 1.6B Technical Report
Marco Bellagente, Jonathan Tow, Dakota Mahan +16
We introduce StableLM 2 1.6B, the first in a new generation of our language model series. In this technical report, we present in detail the data and training procedure leading to…