activity
20232026
most citedMissing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP

4 citations · 5 across the 4 of their papers we have counts for

collaborators

5 papers

cs.CL2026

UIC-AIHealth4All at ArchEHR-QA 2026: Answer-First Evidence Grounding for Clinical Question Answering

Mohammad Arvan, Hossein Haeri, Natalie Parde +1

We describe the UIC-AIHealth4All system for ArchEHR-QA 2026, a shared task on grounded question answering from electronic health records. We participated in Subtasks 2 (evidence id…

cs.CL2026

Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries

Mohammad Arvan, Amber E. Osterholt, Bailee Rue +5

Introduction. Clinical and Translational Science Award (CTSA) programs must document their scholars' research impact, but assembling each scholar's record by hand takes staff an es…

cs.AI2025

TeamMedAgents: Pareto-Efficient Multi-Agent Medical Reasoning Through Teamwork Theory

Pranav Pushkar Mishra, Mohammad Arvan, Mohan Zalake

Complex medical reasoning has historically required frontier language models to achieve clinically-acceptable accuracy, creating computational barriers that limit deployment in res…

cs.DL2023★ 1 cited

Investigating Reproducibility at Interspeech Conferences: A Longitudinal and Comparative Perspective

Mohammad Arvan, A. Seza Doğruöz, Natalie Parde

Reproducibility is a key aspect for scientific advancement across disciplines, and reducing barriers for open science is a focus area for the theme of Interspeech 2023. Availabilit…

cs.CL2023★ 4 cited

Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP

Anya Belz, Craig Thomson, Ehud Reiter +39

We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study examining what makes human evaluations in NLP more/le…