4 papers · 1 filter
Lower-Resource, Higher Scores: Language Bias in LLM Evaluators
Ej Zhou, Lucas Resck, Zheng Hui +1
LLM evaluators (trained reward models and prompted LLM-as-a-Judge) are routinely validated via pairwise accuracy. In a multilingual setting, this operates under the premise that hi…
Mitigating Cross-Lingual Cultural Inconsistencies in LLMs via Consensus-Driven Preference Optimisation
Lucas Resck, Isabelle Augenstein, Anna Korhonen
Despite their impressive capabilities, multilingual large language models (MLLMs) frequently exhibit inconsistent behaviour when the prompt's language changes. While such adaptatio…
Empirical analysis of binding precedent efficiency in Brazilian Supreme Court via case classification
Raphaël Tinarrage, Henrique Ennes, Lucas Resck +3
Binding precedents (súmulas vinculantes) constitute a juridical instrument unique to the Brazilian legal system and whose objectives include the protection of the Federal Supreme C…
Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales
Lucas E. Resck, Marcos M. Raimundo, Jorge Poco
Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not…