2 citations · 3 across the 13 of their papers we have counts for
15 papers
InvestigationWorlds: An Agentic Environment for Legal Investigation
Albert Yu Sun, Andrew Benard, Sil Hamilton +8
We introduce InvestigationWorlds, an agentic environment for legal investigation. We build on an underused artifact of U.S. civil litigation: the summary judgment motion. This moti…
CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases
Sil Hamilton, Albert Yu Sun, Oscar J. Romero +4
LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don't want to share internal communications, a…
The Plot Thins: Uniformity and Linearity in Literary Summaries
Rebecca M. M. Hicke, Sil Hamilton, David Mimno +1
Works of literature are complicated; they balance plot, suspense, surprise, and artistic expression. Summaries of literature prioritize plot, and therefore may deviate from their s…
Elias in the Lighthouse, Again? Diagnosing Low Diversity in LLM Stories
Sil Hamilton, David Mimno
LLM-generated stories are a popular use case, but they show very low variability. We sample 20,000 total stories from four current models using five prompts. We find that 11 words…
Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries
Rebecca M. M. Hicke, Sil Hamilton, David Mimno +1
Although LLM context lengths have grown, there is evidence that their ability to integrate information across long-form texts has not kept pace. We evaluate one such understanding…
Are You There God? Lightweight Narrative Annotation of Christian Fiction with LMs
Rebecca M. M. Hicke, Brian W. Haggard, Mia Ferrante +2
In addition to its more widely studied cultural movements, American Evangelicalism has a well-developed but less externally visible literary side. Christian Fiction, however, has b…
Too Long, Didn't Model: Decomposing LLM Long-Context Understanding With Novels
Sil Hamilton, Rebecca M. M. Hicke, Matthew Wilkens +1
Although the context length of large language models (LLMs) has increased to millions of tokens, evaluating their effectiveness beyond needle-in-a-haystack approaches has proven di…
The Zero Body Problem: Probing LLM Use of Sensory Language
Rebecca M. M. Hicke, Sil Hamilton, David Mimno
Sensory language expresses embodied experiences ranging from taste and sound to excitement and stomachache. This language is of interest to scholars from a wide range of domains in…
Tasks and Roles in Legal AI: Data Curation, Annotation, and Verification
Allison Koenecke, Jed Stiglitz, David Mimno +1
The application of AI tools to the legal field feels natural: large legal document collections could be used with specialized AI to improve workflow efficiency for lawyers and amel…
Do Chinese models speak Chinese languages?
Andrea W Wen-Yi, Unso Eun Seo Jo, David Mimno
The release of top-performing open-weight LLMs has cemented China's role as a leading force in AI development. Do these models support languages spoken in China? Or do they support…
A City of Millions: Mapping Literary Social Networks At Scale
Sil Hamilton, Rebecca M. M. Hicke, David Mimno +1
We release 70,509 high-quality social networks extracted from multilingual fiction and nonfiction narratives. We additionally provide metadata for 30,000 of these texts (73\%…
Lost in Space: Finding the Right Tokens for Structured Output
Sil Hamilton, David Mimno
General-purpose language models are trained to produce varied natural language outputs, but for some tasks, like annotation or classification, we need more specific output formats.…
Automate or Assist? The Role of Computational Models in Identifying Gendered Discourse in US Capital Trial Transcripts
Andrea W Wen-Yi, Kathryn Adamson, Nathalie Greenfield +4
The language used by US courtroom actors in criminal trials has long been studied for biases. However, systematic studies for bias in high-stakes court trials have been difficult,…
How Chinese are Chinese Language Models? The Puzzling Lack of Language Policy in China's LLMs
Andrea W Wen-Yi, Unso Eun Seo Jo, Lu Jia Lin +1
Contemporary language models are increasingly multilingual, but Chinese LLM developers must navigate complex political and business considerations of language diversity. Language p…
Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddings
Andrea W Wen-Yi, David Mimno
Cross-lingual transfer learning is an important property of multilingual large language models (LLMs). But how do LLMs represent relationships between languages? Every language mod…