12 citations · 37 across the 12 of their papers we have counts for
4 papers · 1 filter
CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
Jon Chun, Hannah Sussman, Adrian Mangine +13
Pragmatic reasoning, inferring intended meaning beyond literal semantics, underpins everyday communication yet remains difficult for large language models. We present the Contextua…
Syntactic Framing Fragility: An Audit of Robustness in LLM Ethical Decisions
Katherine Elkins, Jon Chun
Large language models exhibit systematic negation sensitivity, yet no operational framework exists to measure this vulnerability at deployment scale, especially in high-stakes deci…
SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs
Jon Chun
SOTA Transformer and DNN short text sentiment classifiers report over 97% accuracy on narrow domains like IMDB movie reviews. Real-world performance is significantly lower because…
Can Sentiment Analysis Reveal Structure in a Plotless Novel?
Katherine Elkins, Jon Chun
Modernist novels are thought to break with traditional plot structure. In this paper, we test this theory by applying Sentiment Analysis to one of the most famous modernist novels,…