7 papers
Legal Domain Adaptation of Modern BERT Models
Dominik Stammbach, Peter Henderson
We investigate domain adaptation of modern BERT models in the legal domain. We further pre-train ModernBERT on all US court opinions using the masked language modeling objective. A…
Legal Retrieval for Public Defenders
Dominik Stammbach, Kylie Zhang, Patty Liu +4
AI tools are suggested as solutions to assist public agencies with heavy workloads. In public defense -- where a constitutional right to counsel meets the complexities of law, over…
How Can AI Augment Access to Justice? Public Defenders' Perspectives on AI Adoption
Inyoung Cheong, Patty Liu, Dominik Stammbach +1
Public defenders are asked to do more with less: representing clients deserving of adequate counsel while facing overwhelming caseloads and scarce resources. Although artificial in…
What Is The Political Content in LLMs' Pre- and Post-Training Data?
Tanise Ceron, Dmitry Nikolaev, Dominik Stammbach +1
Large language models (LLMs) are known to generate politically biased text. Yet, it remains unclear how such biases arise, making it difficult to design effective mitigation strate…
AI-Assisted Moot Courts: Simulating Justice-Specific Questioning in Oral Arguments
Kylie Zhang, Nimra Nadeem, Lucia Zheng +2
In oral arguments, judges probe attorneys with questions about the factual record, legal claims, and the strength of their arguments. To prepare for this questioning, both law scho…
NLP for Social Good: A Survey and Outlook of Challenges, Opportunities, and Responsible Deployment
Antonia Karamolegkou, Angana Borah, Eunjung Cho +30
Natural language processing (NLP) now shapes many aspects of our world, yet its potential for positive social impact is underexplored. This paper surveys work in ``NLP for Social G…