121 citations · 260 across the 10 of their papers we have counts for
11 papers
CruxBench: A Benchmark of Information Discovery
Hui Dai, Lina Piao, Nick Merrill +3
Benchmarks for large language models (LLMs) typically evaluate the accuracy of answers against fixed reference labels. But a central step in many complex real-world tasks is identi…
ForecastBench-Sim: A Simulated-World Forecasting Benchmark
Jaeho Lee, Nick Merrill, Ezra Karger
Forecasting benchmarks for general-purpose AI systems usually inherit the constraints of the real world: outcomes resolve slowly, tail events are rare, and counterfactual questions…
Symmetry Defeats Auditing
Nick Merrill, Zeke Medley
We demonstrate an attack on Introspection Adapters (Shenoy et al., 2026).
Is Capability a Liability? More Capable Language Models Make Worse Forecasts When It Matters Most
Nick Merrill, Jaeho Lee, Ezra Karger
We document inverse scaling in LLMs on forecasting problems whose underlying time series exhibit superlinear growth and tail risk of regime change, a structure common in finance an…
The Medium is the Message: How Secure Messaging Apps Leak Sensitive Data to Push Notification Services
Nikita Samarin, Alex Sanchez, Trinity Chung +5
Like most modern software, secure messaging apps rely on third-party components to implement important app functionality. Although this practice reduces engineering costs, it also…
The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
Jesse Josua Benjamin, Heidi Biggs, Arne Berger +5
Artificial intelligence (AI) technologies are widely deployed in smartphone photography; and prompt-based image synthesis models have rapidly become commonplace. In this paper, we…
The Fungibility of Non-Fungible Tokens: A Quantitative Analysis of ERC-721 Metadata
Sarah Barrington, Nick Merrill
Non-Fungible Tokens (NFTs), digital certificates of ownership for virtual art, have until recently been traded on a highly lucrative and speculative market. Yet, an emergence of mi…
Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
Richmond Y. Wong, Michael A. Madaio, Nick Merrill
Numerous toolkits have been developed to support ethical AI development. However, toolkits, like all tools, encode assumptions in their design about what work should be done and ho…
This internet, on the ground
Nick Merrill
The internet's key points of global control lie in the hands of a few people, primarily private organizations based in the United States. These control points, as they exist today,…
From Fragmentation to Liberation
Nick Merrill
In this paper, I argue that "Internet fragmentation" as a phenomenon is only meaningful in the context of the US's hegemonic control over the Internet. I propose a broader and, I a…
Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
Jesse Josua Benjamin, Arne Berger, Nick Merrill +1
Design research is important for understanding and interrogating how emerging technologies shape human experience. However, design research with Machine Learning (ML) is relatively…