7 citations · 8 across the 11 of their papers we have counts for
12 papers
PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice
Yuzhen Shi, Huanghai Liu, Yiran Hu +27
As large language models (LLMs) are increasingly applied to legal domain-specific tasks, evaluating their ability to perform legal work in real-world settings has become essential.…
Evaluation of Large Language Models in Legal Applications: Challenges, Methods, and Future Directions
Yiran Hu, Huanghai Liu, Chong Wang +15
Large language models (LLMs) are being increasingly integrated into legal applications, including judicial decision support, legal practice assistance, and public-facing legal serv…
LexRel: Benchmarking Legal Relation Extraction for Chinese Civil Cases
Yida Cai, Ranjuexiao Hu, Huiyuan Xie +6
Legal relations serve as an important analytical framework for dispute resolution in civil cases. However, legal relations in Chinese civil cases remain underexplored in the field…
JustEva: A Toolkit to Evaluate LLM Fairness in Legal Knowledge Inference
Zongyue Xue, Siyuan Zheng, Shaochun Wang +8
The integration of Large Language Models (LLMs) into legal practice raises pressing concerns about judicial fairness, particularly due to the nature of their "black-box" processes.…
LLMs on Trial: Evaluating Judicial Fairness for Large Language Models
Yiran Hu, Zongyue Xue, Haitao Li +10
Large Language Models (LLMs) are increasingly used in high-stakes fields where their decisions impact rights and equity. However, LLMs' judicial fairness and implications for socia…
Legal Rule Induction: Towards Generalizable Principle Discovery from Analogous Judicial Precedents
Wei Fan, Tianshi Zheng, Yiran Hu +7
Legal rules encompass not only codified statutes but also implicit adjudicatory principles derived from precedents that contain discretionary norms, social morality, and policy. Wh…
J&H: Evaluating the Robustness of Large Language Models Under Knowledge-Injection Attacks in Legal Domain
Yiran Hu, Huanghai Liu, Qingjing Chen +5
As the scale and capabilities of Large Language Models (LLMs) increase, their applications in knowledge-intensive fields such as legal domain have garnered widespread attention. Ho…
JUREX-4E: Juridical Expert-Annotated Four-Element Knowledge Base for Legal Reasoning
Huanghai Liu, Quzhe Huang, Qingjing Chen +5
In recent years, Large Language Models (LLMs) have been widely applied to legal tasks. To enhance their understanding of legal texts and improve reasoning accuracy, a promising app…
STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals
Weihang Su, Yiran Hu, Anzhe Xie +6
Statute retrieval aims to find relevant statutory articles for specific queries. This process is the basis of a wide range of legal applications such as legal advice, automated jud…
MUSER: A Multi-View Similar Case Retrieval Dataset
Qingquan Li, Yiran Hu, Feng Yao +4
Similar case retrieval (SCR) is a representative legal AI application that plays a pivotal role in promoting judicial fairness. However, existing SCR datasets only focus on the fac…
LEEC: A Legal Element Extraction Dataset with an Extensive Domain-Specific Label System
Xue Zongyue, Liu Huanghai, Hu Yiran +4
As a pivotal task in natural language processing, element extraction has gained significance in the legal domain. Extracting legal elements from judicial documents helps enhance in…
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
Hao Peng, Xiaozhi Wang, Feng Yao +5
Event extraction (EE) is a crucial task aiming at extracting events from texts, which includes two subtasks: event detection (ED) and event argument extraction (EAE). In this paper…