4 papers
Evaluating the Capabilities of LLMs for Persuasive Dialogue
Jordan Robinson, Angus R. Williams, Katie Atkinson +1
Large language models (LLMs) can generate apparently highly persuasive text, but does sounding persuasive mean arguing well? We introduce \textsc{Persuasio}, a multi-agent dialogue…
Validating Political Position Predictions of Arguments
Jordan Robinson, Angus R. Williams, Katie Atkinson +1
Real-world knowledge representation often requires capturing subjective, continuous attributes -- such as political positions -- that conflict with pairwise validation, the widely…
LeMAJ (Legal LLM-as-a-Judge): Bridging Legal Reasoning and LLM Evaluation
Joseph Enguehard, Morgane Van Ermengem, Kate Atkinson +8
Evaluating large language model (LLM) outputs in the legal domain presents unique challenges due to the complex and nuanced nature of legal analysis. Current evaluation approaches…
Towards Supporting Legal Argumentation with NLP: Is More Data Really All You Need?
T. Y. S. S Santosh, Kevin D. Ashley, Katie Atkinson +1
Modeling legal reasoning and argumentation justifying decisions in cases has always been central to AI & Law, yet contemporary developments in legal NLP have increasingly focused o…