4 papers
Tucano 2 Cool: Better Open Source LLMs for Portuguese
Nicholas Kluge Corrêa, Aniket Sen, Shiza Fatimah +4
We present Tucano 2, a fully open suite of large language models (LLMs) with 0.5-3.7 billion parameters, designed to address certain gaps in open-source development for Portuguese…
Raising Bars, Not Parameters: LilMoo Compact Language Model for Hindi
Shiza Fatimah, Aniket Sen, Sophia Falk +3
The dominance of large multilingual foundation models has widened linguistic inequalities in Natural Language Processing (NLP), often leaving low-resource languages underrepresente…
Tucano: Advancing Neural Text Generation for Portuguese
Nicholas Kluge Corrêa, Aniket Sen, Sophia Falk +1
Significant advances have been made in natural language processing in recent years. However, our current deep learning approach to language modeling requires substantial resources…
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese
Nicholas Kluge Corrêa, Sophia Falk, Shiza Fatimah +2
Large language models (LLMs) have significantly advanced natural language processing, but their progress has yet to be equal across languages. While most LLMs are trained in high-r…