65 citations · 134 across the 25 of their papers we have counts for
26 papers
ReRef-3D: A Benchmark for Spatial Referring Expression-Guided 3D Object Placement
Mary Lynn Martin, Yifei Zhang, Martha Palmer +1
We introduce ReRef-3D, a benchmark for language-guided single-object placement in controlled 3D tabletop scenes. It contains 33,826 instructions across 998 CLEVR-derived scenes, sp…
Discovering Conceptual Metaphors Across Topics and Media Types
Alexandria Leto, Rohan Das, Juan Vásquez +2
Conceptual metaphors guide our thinking and actions by allowing us to reason about more abstract experiences (e.g., paying taxes) in terms of more concrete or embodied experiences…
Narrative-UFET: Narrative Generation for Ultra-Fine Entity Typing
Mreedul Gupta, Advait Deshmukh, Ashwin Umadi +2
Ultra-fine entity typing (UFET) assigns highly specific types to entity mentions, but current approaches struggle with types in the long tail. We hypothesize that a key limitation…
SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing
Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna
Large language models (LLMs) are increasingly used to support scientific work, but it is unclear whether they uphold responsible conduct of research (RCR) norms or help undermine t…
TubeCensus: A Transparent, Replicable, and Large-Scale Census of YouTube Channels and their Subscriber Counts Over Time
Chloe Eggleston, Abram Handler, Maria Leonor Pacheco
YouTube is central to contemporary mass media. However, the official YouTube API does not provide access to the full set of creators or creator metadata on the platform. This lack…
A Structured Clustering Approach for Inducing Media Narratives
Rohan Das, Advait Deshmukh, Alexandria Leto +3
Media narratives wield tremendous power in shaping public opinion, yet computational approaches struggle to capture the nuanced storytelling structures that communication theory em…
How Do We Engage with Other Disciplines? A Framework to Study Meaningful Interdisciplinary Discourse in Scholarly Publications
Bagyasree Sudharsan, Alexandria Leto, Maria Leonor Pacheco
With the rising popularity of interdisciplinary work and increasing institutional incentives in this direction, there is a growing need to understand how resulting publications inc…
LOGICAL-COMMONSENSEQA: A Benchmark for Logical Commonsense Reasoning
Obed Junias, Maria Leonor Pacheco
Commonsense reasoning often involves evaluating multiple plausible interpretations rather than selecting a single atomic answer, yet most benchmarks rely on single-label evaluation…
Mapping the Course for Prompt-based Structured Prediction
Matt Pauk, Maria Leonor Pacheco
Large language models (LLMs) have demonstrated strong performance in a wide-range of language tasks without requiring task-specific fine-tuning. However, they remain prone to hallu…
Explaining Puzzle Solutions in Natural Language: An Exploratory Study on 6x6 Sudoku
Anirudh Maiya, Razan Alghamdi, Maria Leonor Pacheco +2
The success of Large Language Models (LLMs) in human-AI collaborative decision-making hinges on their ability to provide trustworthy, gradual, and tailored explanations. Solving co…
Can LLMs Interpret and Leverage Structured Linguistic Representations? A Case Study with AMRs
Ankush Raut, Xiaofeng Zhu, Maria Leonor Pacheco
This paper evaluates the ability of Large Language Models (LLMs) to leverage contextual information in the form of structured linguistic representations. Specifically, we examine t…
CLIX: Cross-Lingual Explanations of Idiomatic Expressions
Aaron Gluck, Katharina von der Wense, Maria Leonor Pacheco
Automated definition generation systems have been proposed to support vocabulary expansion for language learners. The main barrier to the success of these systems is that learners…
Media Framing through the Lens of Event-Centric Narratives
Rohan Das, Aditya Chandra, I-Ta Lee +1
From a communications perspective, a frame defines the packaging of the language used in such a way as to encourage certain interpretations and to discourage others. For example, a…
All Entities are Not Created Equal: Examining the Long Tail for Ultra-Fine Entity Typing
Advait Deshmukh, Ashwin Umadi, Dananjay Srinivas +1
Due to their capacity to acquire world knowledge from large corpora, pre-trained language models (PLMs) are extensively used in ultra-fine entity typing tasks where the space of la…
Effects of Collaboration on the Performance of Interactive Theme Discovery Systems
Alvin Po-Chun Chen, Rohan Das, Dananjay Srinivas +3
NLP-assisted solutions to support qualitative data analysis have gained considerable traction. However, no unified evaluation framework exists which can account for the many differ…
Framing in the Presence of Supporting Data: A Case Study in U.S. Economic News
Alexandria Leto, Elliot Pickens, Coen D. Needell +2
The mainstream media has much leeway in what it chooses to cover and how it covers it. These choices have real-world consequences on what people know and their subsequent behaviors…
On the Potential and Limitations of Few-Shot In-Context Learning to Generate Metamorphic Specifications for Tax Preparation Software
Dananjay Srinivas, Rohan Das, Saeid Tizpaz-Niari +2
Due to the ever-increasing complexity of income tax laws in the United States, the number of US taxpayers filing their taxes using tax preparation software (henceforth, tax softwar…
Interactive Concept Learning for Uncovering Latent Themes in Large Text Collections
Maria Leonor Pacheco, Tunazzina Islam, Lyle Ungar +2
Experts across diverse disciplines are often interested in making sense of large text collections. Traditionally, this challenge is approached either by noisy unsupervised techniqu…
Queer In AI: A Case Study in Community-Led Participatory AI
Organizers Of QueerInAI, :, Anaelia Ovalle +48
We present Queer in AI as a case study for community-led participatory design in AI. We examine how participatory design and intersectional tenets started and shaped this community…
A Holistic Framework for Analyzing the COVID-19 Vaccine Debate
Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan +4
The Covid-19 pandemic has led to infodemic of low quality information leading to poor health decisions. Combating the outcomes of this infodemic is not only a question of identifyi…
Automated Attack Synthesis by Extracting Finite State Machines from Protocol Specification Documents
Maria Leonor Pacheco, Max von Hippel, Ben Weintraub +2
Automated attack discovery techniques, such as attacker synthesis or model-based fuzzing, provide powerful ways to ensure network protocols operate correctly and securely. Such tec…
Identifying Morality Frames in Political Tweets using Relational Learning
Shamik Roy, Maria Leonor Pacheco, Dan Goldwasser
Extracting moral sentiment from text is a vital component in understanding public opinion, social movements, and policy decisions. The Moral Foundation Theory identifies five moral…
Modeling Human Mental States with an Entity-based Narrative Graph
I-Ta Lee, Maria Leonor Pacheco, Dan Goldwasser
Understanding narrative text requires capturing characters' motivations, goals, and mental states. This paper proposes an Entity-based Narrative Graph (ENG) to model the internal-s…
Randomized Deep Structured Prediction for Discourse-Level Processing
Manuel Widmoser, Maria Leonor Pacheco, Jean Honorio +1
Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturi…