12 citations · 37 across the 12 of their papers we have counts for
12 papers
Auditing Game-Theoretic Measures of Strategic Reasoning in LLMs
Mateo Pechon-Elkins, Jon Chun
Game-theoretic benchmarks can separate distinct forms of strategic behavior in LLMs that aggregate theory of mind scores do not distinguish, but only if those benchmarks measure wh…
CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
Jon Chun, Hannah Sussman, Adrian Mangine +13
Pragmatic reasoning, inferring intended meaning beyond literal semantics, underpins everyday communication yet remains difficult for large language models. We present the Contextua…
AgenticSimLaw: A Juvenile Courtroom Multi-Agent Debate Simulation for Explainable High-Stakes Tabular Decision Making
Jon Chun, Kathrine Elkins, Yong Suk Lee
We introduce AgenticSimLaw, a role-structured, multi-agent debate framework that provides transparent and controllable test-time reasoning for high-stakes tabular decision-making t…
The Paradox of Robustness: Decoupling Rule-Based Logic from Affective Noise in High-Stakes Decision-Making
Jon Chun, Katherine Elkins
While Large Language Models (LLMs) are widely documented to be sensitive to minor prompt perturbations and prone to sycophantic alignment, their robustness in consequential, rule-b…
Framing Instability in LLM Ethical Stance: Auditing Negation Sensitivity in Moral Dilemmas
Katherine Elkins, Jon Chun
Language models are increasingly consulted on ethically consequential questions, yet the stance a model expresses may not survive a change in framing. We audit 16 models across 14…
Syntactic Framing Fragility: An Audit of Robustness in LLM Ethical Decisions
Katherine Elkins, Jon Chun
Large language models exhibit systematic negation sensitivity, yet no operational framework exists to measure this vulnerability at deployment scale, especially in high-stakes deci…
Comparative Global AI Regulation: Policy Perspectives from the EU, China, and the US
Jon Chun, Christian Schroeder de Witt, Katherine Elkins
As a powerful and rapidly advancing dual-use technology, AI offers both immense benefits and worrisome risks. In response, governing bodies around the world are developing a range…
Risks and Opportunities of Open-Source Generative AI
Francisco Eiras, Aleksandar Petrov, Bertie Vidgen +22
Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic chan…
Near to Mid-term Risks and Opportunities of Open-Source Generative AI
Francisco Eiras, Aleksandar Petrov, Bertie Vidgen +21
In the next few years, applications of Generative AI are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for thes…
Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values
Jon Chun, Katherine Elkins
With the rise of individual and collaborative networks of autonomous agents, AI is deployed in more key reasoning and decision-making roles. For this reason, ethics-based audits pl…
SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs
Jon Chun
SOTA Transformer and DNN short text sentiment classifiers report over 97% accuracy on narrow domains like IMDB movie reviews. Real-world performance is significantly lower because…
Can Sentiment Analysis Reveal Structure in a Plotless Novel?
Katherine Elkins, Jon Chun
Modernist novels are thought to break with traditional plot structure. In this paper, we test this theory by applying Sentiment Analysis to one of the most famous modernist novels,…