1 citations · 2 across the 9 of their papers we have counts for
8 papers · 1 filter
Teaching LLMs Brazilian Healthcare: Injecting Knowledge from Official Clinical Guidelines
Hugo Abonizio, Filipe Rocha Lopes, Roberto Lotufo +1
Brazil's Unified Health System (SUS) relies on official clinical guidelines that define diagnostic criteria, treatments, dosages, and monitoring procedures for over 200 million cit…
Comparing Knowledge Injection Methods for LLMs in a Low-Resource Regime
Hugo Abonizio, Thales Almeida, Roberto Lotufo +1
Large language models (LLMs) often require vast amounts of text to effectively acquire new knowledge. While continuing pre-training on large corpora or employing retrieval-augmente…
MLissard: Multilingual Long and Simple Sequential Reasoning Benchmarks
Mirelle Bueno, Roberto Lotufo, Rodrigo Nogueira
Language models are now capable of solving tasks that require dealing with long sequences consisting of hundreds of thousands of tokens. However, they often fail on tasks that requ…
PublicHearingBR: A Brazilian Portuguese Dataset of Public Hearing Transcripts for Summarization of Long Documents
Leandro Carísio Fernandes, Guilherme Zeferino Rodrigues Dobins, Roberto Lotufo +1
This paper introduces PublicHearingBR, a Brazilian Portuguese dataset designed for summarizing long documents. The dataset consists of transcripts of public hearings held by the Br…
SurveySum: A Dataset for Summarizing Multiple Scientific Articles into a Survey Section
Leandro Carísio Fernandes, Gustavo Bartz Guedes, Thiago Soares Laitz +4
Document summarization is a task to shorten texts into concise and informative summaries. This paper introduces a novel dataset designed for summarizing multiple scientific article…
Check-Eval: A Checklist-based Approach for Evaluating Text Quality
Jayr Pereira, Andre Assumpcao, Roberto Lotufo
Evaluating the quality of text generated by large language models (LLMs) remains a significant challenge. Traditional metrics often fail to align well with human judgments, particu…
ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Language
Marcos Piau, Roberto Lotufo, Rodrigo Nogueira
Despite advancements in Natural Language Processing (NLP) and the growing availability of pretrained models, the English language remains the primary focus of model development. Co…
Measuring Cross-lingual Transfer in Bytes
Leandro Rodrigues de Souza, Thales Sales Almeida, Roberto Lotufo +1
Multilingual pretraining has been a successful solution to the challenges posed by the lack of resources for languages. These models can transfer knowledge to target languages with…