369 citations · 1.2k across the 41 of their papers we have counts for
42 papers
Unsnarling the Red Tape: Computational Infrastructure for Regulatory Systems
Vinay K. Chaudhri, Henry F. Korth, Patrick A. McLaughlin +4
Regulatory complexity is increasingly recognized as an impediment to innovation, institutional responsiveness, and long-run economic growth, with regulatory accumulation estimated…
Personalized Assessments from Personal Artifacts
Yufan Zhang, Jaromir Savelka, Seth Copen Goldstein +1
The rapid development and popularization of AI-enabled coding agents have meant software engineering students and professionals cannot be assumed to understand their own code, whic…
Prompting Beats Fine-Tuning: Generative Expected Value Scoring for Statutory Term Retrieval
Alvin Wang, Jaromir Savelka
Legal concepts in statutes are often expressed using vague terms, and practitioners frequently turn to case law to interpret them. We study the task of ranking case-law sentences b…
DLawBench: Evaluating LLMs Through Multi-Turn Legal Consultation
Li Zhang, Yuzhen Shi, Yiran Hu +15
Lawyer-client consultation is a critical starting point for legal services. Effective legal assistance hinges on eliciting sufficient and truthful information from clients in order…
Can LLMs Create Legally Relevant Summaries and Analyses of Videos?
Lyra Hoeben-Kuil, Gijs van Dijck, Jaromir Savelka +6
Understanding the legally relevant factual basis of an event and conveying it through text is a key skill of legal professionals. This skill is important for preparing forms (e.g.,…
AI Literacy Assessment Revisited: A Task-Oriented Approach Aligned with Real-world Occupations
Christopher Bogart, Aparna Warrier, Arav Agarwal +6
As artificial intelligence (AI) systems become ubiquitous in professional contexts, there is an urgent need to equip workers, often with backgrounds outside of STEM, with the skill…
"I Like That You Have to Poke Around": Instructors on How Experiential Approaches to AI Literacy Spark Inquiry and Critical Thinking
Aparna Maya Warrier, Arav Agarwal, Jaromir Savelka +2
As artificial intelligence (AI) increasingly shapes decision-making across domains, there is a growing need to support AI literacy among learners beyond computer science. However,…
AI Literacy for Community Colleges: Instructors' Perspectives on Scenario-Based and Interactive Approaches to Teaching AI
Aparna Maya Warrier, Arav Agarwal, Jaromir Savelka +2
This research category full paper investigates how community college instructors evaluate interactive, no-code AI literacy resources designed for non-STEM learners. As artificial i…
Do LLMs Truly Understand When a Precedent Is Overruled?
Li Zhang, Jaromir Savelka, Kevin Ashley
Large language models (LLMs) with extended context windows show promise for complex legal reasoning tasks, yet their ability to understand long legal documents remains insufficient…
Measuring Faithfulness and Abstention: An Automated Pipeline for Evaluating LLM-Generated 3-ply Case-Based Legal Arguments
Li Zhang, Morgan Gray, Jaromir Savelka +1
Large Language Models (LLMs) demonstrate potential in complex legal tasks like argument generation, yet their reliability remains a concern. Building upon pilot work assessing LLM…
AI Technicians: Developing Rapid Occupational Training Methods for a Competitive AI Workforce
Jaromir Savelka, Can Kultur, Arav Agarwal +4
The accelerating pace of developments in Artificial Intelligence~(AI) and the increasing role that technology plays in society necessitates substantial changes in the structure of…
Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools
James Prather, Juho Leinonen, Natalie Kiesler +12
Generative AI (GenAI) is advancing rapidly, and the literature in computing education is expanding almost as quickly. Initial responses to GenAI tools were mixed between panic and…
Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice
Hannes Westermann, Jaromir Savelka
Interacting with the legal system and the government requires the assembly and analysis of various pieces of information that can be spread across different (paper) documents, such…
Using LLMs to Discover Legal Factors
Morgan Gray, Jaromir Savelka, Wesley Oliver +1
Factors are a foundational component of legal analysis and computational models of legal reasoning. These factor-based representations enable lawyers, judges, and AI and Law resear…
Robots in the Middle: Evaluating LLMs in Dispute Resolution
Jinzhe Tan, Hannes Westermann, Nikhil Reddy Pottanigari +4
Mediation is a dispute resolution method featuring a neutral third-party (mediator) who intervenes to help the individuals resolve their dispute. In this paper, we investigate to w…
It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human
Jakub Harasta, Tereza Novotná, Jaromir Savelka
Large Language Models (LLMs) enable a future in which certain types of legal documents may be generated automatically. This has a great potential to streamline legal processes, low…
Desirable Characteristics for AI Teaching Assistants in Programming Education
Paul Denny, Stephen MacNeil, Jaromir Savelka +2
Providing timely and personalized feedback to large numbers of students is a long-standing challenge in programming courses. Relying on human teaching assistants (TAs) has been ext…
Understanding the Role of Temperature in Diverse Question Generation by GPT-4
Arav Agarwal, Karthik Mittal, Aidan Doyle +5
We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions. We find that using higher temperature values leads to sign…
A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education
Jacob Doughty, Zipiao Wan, Anishka Bompelli +12
There is a constant need for educators to develop and maintain effective up-to-date assessments. While there is a growing body of research in computing education on utilizing large…
From GPT-3 to GPT-4: On the Evolving Efficacy of LLMs to Answer Multiple-choice Questions for Programming Classes in Higher Education
Jaromir Savelka, Arav Agarwal, Christopher Bogart +1
We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermedia…
From Text to Structure: Using Large Language Models to Support the Development of Legal Expert Systems
Samyar Janatian, Hannes Westermann, Jinzhe Tan +2
Encoding legislative text in a formal representation is an important prerequisite to different tasks in the field of AI & Law. For example, rule-based expert systems focused on leg…
Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models
Jaromir Savelka, Paul Denny, Mark Liffiton +1
The accurate classification of student help requests with respect to the type of help being sought can enable the tailoring of effective responses. Automatically classifying such r…
Using Large Language Models to Support Thematic Analysis in Empirical Legal Studies
Jakub Drápal, Hannes Westermann, Jaromir Savelka
Thematic analysis and other variants of inductive coding are widely used qualitative analytic methods within empirical legal studies (ELS). We propose a novel framework facilitatin…
Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant
Brad Sheese, Mark Liffiton, Jaromir Savelka +1
Providing personalized assistance at scale is a long-standing challenge for computing educators, but a new generation of tools powered by large language models (LLMs) offers immens…