1 citations · 1 across the 9 of their papers we have counts for
6 papers · 1 filter
Language Models are Lazy Poets: Creative Mode Collapse at Scale
Jacob A. Matthews, Sil Hamilton
While aligned large language models (LLMs) can successfully complete many creative tasks, their outputs tend to be highly self-similar. Though solutions to this problem of "mode co…
InvestigationWorlds: An Agentic Environment for Legal Investigation
Albert Yu Sun, Andrew Benard, Sil Hamilton +8
We introduce InvestigationWorlds, an agentic environment for legal investigation. We build on an underused artifact of U.S. civil litigation: the summary judgment motion. This moti…
CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases
Sil Hamilton, Albert Yu Sun, Oscar J. Romero +4
LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don't want to share internal communications, a…
The Plot Thins: Uniformity and Linearity in Literary Summaries
Rebecca M. M. Hicke, Sil Hamilton, David Mimno +1
Works of literature are complicated; they balance plot, suspense, surprise, and artistic expression. Summaries of literature prioritize plot, and therefore may deviate from their s…
Elias in the Lighthouse, Again? Diagnosing Low Diversity in LLM Stories
Sil Hamilton, David Mimno
LLM-generated stories are a popular use case, but they show very low variability. We sample 20,000 total stories from four current models using five prompts. We find that 11 words…
Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries
Rebecca M. M. Hicke, Sil Hamilton, David Mimno +1
Although LLM context lengths have grown, there is evidence that their ability to integrate information across long-form texts has not kept pace. We evaluate one such understanding…