39 citations · 64 across the 16 of their papers we have counts for
4 papers · 1 filter
Beyond Aggregate Scores: Behavioral Correctness Assumptions for Assessing Reference-Based Automatic Evaluation Methods
Maria Mahbub, Ashley Rice, Michael R. Munroe +2
Automated reference-based evaluation methods play a critical role in assessing natural language generation systems. Existing meta-evaluation primarily measures agreement with human…
Extending the Horizon of Early Diagnosis: Lung Cancer Prediction with Vision Transformers
Olivera Kotevska, Ian Goethert, Michael McGee +11
Lung cancer remains a leading cause of cancer-related mortality worldwide, and early diagnosis is critical for improving survival. However, early-stage malignancies can be subtle o…
Signal-based Model Access Risk Analysis for AI System Operations Security
Maria Mahbub, Steven Young, Amir Sadovnik +4
Artificial intelligence (AI) systems are now ubiquitous across domains such as security, finance, healthcare, consumer technology, and large-scale cloud services, where they proces…
A Multi-Stage Validation Framework for Trustworthy Large-scale Clinical Information Extraction using Large Language Models
Maria Mahbub, Gregory M. Dams, Josh Arnold +9
Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is const…