5 papers
Tucano 2 Cool: Better Open Source LLMs for Portuguese
Nicholas Kluge Corrêa, Aniket Sen, Shiza Fatimah +4
We present Tucano 2, a fully open suite of large language models (LLMs) with 0.5-3.7 billion parameters, designed to address certain gaps in open-source development for Portuguese…
Raising Bars, Not Parameters: LilMoo Compact Language Model for Hindi
Shiza Fatimah, Aniket Sen, Sophia Falk +3
The dominance of large multilingual foundation models has widened linguistic inequalities in Natural Language Processing (NLP), often leaving low-resource languages underrepresente…
From FLOPs to Footprints: The Resource Cost of Artificial Intelligence
Sophia Falk, Nicholas Kluge Corrêa, Sasha Luccioni +2
As computational demands continue to rise, assessing the environmental footprint of AI requires moving beyond energy and water consumption to include the material demands of specia…
Superalignment with Dynamic Human Values
Florian Mai, David Kaczér, Nicholas Kluge Corrêa +1
Two core challenges of alignment are 1) scalable oversight and 2) accounting for the dynamic nature of human values. While solutions like recursive reward modeling address 1), they…
Tucano: Advancing Neural Text Generation for Portuguese
Nicholas Kluge Corrêa, Aniket Sen, Sophia Falk +1
Significant advances have been made in natural language processing in recent years. However, our current deep learning approach to language modeling requires substantial resources…