15 papers
BenGER Platform: A Collaborative Web Platform for End-to-End Benchmarking of German Legal Tasks
Sebastian Nagl, Matthias Grabmair
Evaluating large language models (LLMs) for legal reasoning requires workflows that span task design, expert annotation, model execution, and metric-based evaluation. In practice,…
CourtPressGER: A German Court Decision to Press Release Summarization Dataset
Sebastian Nagl, Mohamed Elganayni, Melanie Pospisil +1
Official court press releases from Germany's highest courts present and explain judicial rulings to the public, as well as to expert audiences. Prior NLP efforts emphasize technica…
Efficient Prompt Optimisation for Legal Text Classification with Proxy Prompt Evaluator
Hyunji Lee, Kevin Chenhao Li, Matthias Grabmair +1
Prompt optimization aims to systematically refine prompts to enhance a language model's performance on specific tasks. Fairness detection in Terms of Service (ToS) clauses is a cha…
Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases
Shanshan Xu, T. Y. S. S Santosh, Yanai Elazar +3
Recent works have shown that Large Language Models (LLMs) have a tendency to memorize patterns and biases present in their training data, raising important questions about how such…
LexGenie: Automated Generation of Structured Reports for European Court of Human Rights Case Law
T. Y. S. S Santosh, Mahmoud Aly, Oana Ichim +1
Analyzing large volumes of case law to uncover evolving legal principles, across multiple cases, on a given topic is a demanding task for legal professionals. Structured topical re…
LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases
T. Y. S. S. Santosh, Isaac Misael OlguÃn Nolasco, Matthias Grabmair
Prior case retrieval (PCR) is crucial for legal practitioners to find relevant precedent cases given the facts of a query case. Existing approaches often overlook the underlying se…