39 citations · 64 across the 16 of their papers we have counts for
4 papers · 1 filter
Beyond Aggregate Scores: Behavioral Correctness Assumptions for Assessing Reference-Based Automatic Evaluation Methods
Maria Mahbub, Ashley Rice, Michael R. Munroe +2
Automated reference-based evaluation methods play a critical role in assessing natural language generation systems. Existing meta-evaluation primarily measures agreement with human…
ORCHID: Orchestrated Retrieval-Augmented Classification with Human-in-the-Loop Intelligent Decision-Making for High-Risk Property
Maria Mahbub, Vanessa Lama, Sanjay Das +6
High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must trac…
Advancing NLP Security by Leveraging LLMs as Adversarial Engines
Sudarshan Srinivasan, Maria Mahbub, Amir Sadovnik
This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building u…
Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes
Maria Mahbub, Ian Goethert, Ioana Danciu +9
Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can be…