Parameterized Argumentation-based Reasoning Tasks for Benchmarking Generative Language Models

Cor Steging, Silja Renooij, Bart Verheij

Generative large language models as tools in the legal domain have the potential to improve the justice system. However, the reasoning behavior of current generative models is brit…