12 papers
Personalized Assessments from Personal Artifacts
Yufan Zhang, Jaromir Savelka, Seth Copen Goldstein +1
The rapid development and popularization of AI-enabled coding agents have meant software engineering students and professionals cannot be assumed to understand their own code, whic…
Prompting Beats Fine-Tuning: Generative Expected Value Scoring for Statutory Term Retrieval
Alvin Wang, Jaromir Savelka
Legal concepts in statutes are often expressed using vague terms, and practitioners frequently turn to case law to interpret them. We study the task of ranking case-law sentences b…
DLawBench: Evaluating LLMs Through Multi-Turn Legal Consultation
Li Zhang, Yuzhen Shi, Yiran Hu +15
Lawyer-client consultation is a critical starting point for legal services. Effective legal assistance hinges on eliciting sufficient and truthful information from clients in order…
Can LLMs Create Legally Relevant Summaries and Analyses of Videos?
Lyra Hoeben-Kuil, Gijs van Dijck, Jaromir Savelka +6
Understanding the legally relevant factual basis of an event and conveying it through text is a key skill of legal professionals. This skill is important for preparing forms (e.g.,…
AI Literacy Assessment Revisited: A Task-Oriented Approach Aligned with Real-world Occupations
Christopher Bogart, Aparna Warrier, Arav Agarwal +6
As artificial intelligence (AI) systems become ubiquitous in professional contexts, there is an urgent need to equip workers, often with backgrounds outside of STEM, with the skill…
"I Like That You Have to Poke Around": Instructors on How Experiential Approaches to AI Literacy Spark Inquiry and Critical Thinking
Aparna Maya Warrier, Arav Agarwal, Jaromir Savelka +2
As artificial intelligence (AI) increasingly shapes decision-making across domains, there is a growing need to support AI literacy among learners beyond computer science. However,…