9 citations · 27 across the 8 of their papers we have counts for
8 papers
In Defense of Cross-Encoders for Zero-Shot Retrieval
Guilherme Rosa, Luiz Bonifacio, Vitor Jeronymo +4
Bi-encoders and cross-encoders are widely used in many state-of-the-art retrieval pipelines. In this work we study the generalization ability of these two types of architectures on…
A Boring-yet-effective Approach for the Product Ranking Task of the Amazon KDD Cup 2022
Vitor Jeronymo, Guilherme Rosa, Surya Kallumadi +2
In this work we describe our submission to the product ranking task of the Amazon KDD Cup 2022. We rely on a receipt that showed to be effective in previous competitions: we focus…
No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo +4
Recent work has shown that small distilled language models are strong competitors to models that are orders of magnitude larger and slower in a wide range of information retrieval…
Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Task
Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo +3
Recent work has shown that language models scaled to billions of parameters, such as GPT-3, perform remarkably well in zero-shot and few-shot scenarios. In this work, we experiment…
To Tune or Not To Tune? Zero-shot Models for Legal Case Entailment
Guilherme Moraes Rosa, Ruan Chaves Rodrigues, Roberto de Alencar Lotufo +1
There has been mounting evidence that pretrained language models fine-tuned on large and diverse supervised datasets can transfer well to a variety of out-of-domain tasks. In this…
Sequence-to-Sequence Models for Extracting Information from Registration and Legal Documents
Ramon Pires, Fábio C. de Souza, Guilherme Rosa +2
A typical information extraction pipeline consists of token- or span-level classification models coupled with a series of pre- and post-processing scripts. In a production pipeline…
A cost-benefit analysis of cross-lingual transfer methods
Guilherme Moraes Rosa, Luiz Henrique Bonifacio, Leandro Rodrigues de Souza +2
An effective method for cross-lingual transfer is to fine-tune a bilingual or multilingual model on a supervised dataset in one language and evaluating it on another language in a…
Yes, BM25 is a Strong Baseline for Legal Case Retrieval
Guilherme Moraes Rosa, Ruan Chaves Rodrigues, Roberto Lotufo +1
We describe our single submission to task 1 of COLIEE 2021. Our vanilla BM25 got second place, well above the median of submissions. Code is available at https://github.com/neuralm…