8 papers
LLMs Anchor on Chief Complaint and Fail to Integrate Evidence in Sequential Clinical Triage
Dipankar Srirag, Haokai Zhao, Ashutosh Kumar +6
Triage in the emergency department (ED) is a sequential decision process that unfolds turn by turn. Existing evaluations of large language models (LLMs) for triage use completed re…
Last Translation Benchmark
Vilém Zouhar, Niyati Bafna, Mukund Choudhary +263
For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that inform us about failure cases. As models get stronger, stan…
From Triage to Discharge: A Survey of NLP Tasks, Methods, and Open Challenges in the Emergency Department
Dipankar Srirag, Aditya Joshi, Salil Kanhere +1
Emergency departments (EDs) operate under time pressure, generating multimodal data such as clinical conversations, triage notes, and discharge documents. Recent advances in natura…
PAREDA: A Multi-Accent Speech Dataset of Natural Language Processing Research Discussions
Sicheng Jin, Dipankar Srirag, Aditya Joshi
While modern Automatic Speech Recognition (ASR) systems achieve high accuracy on benchmark corpora, their performance often degrades when there is real-world variability. This work…
TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Records
Dipankar Srirag, Quoc Dung Nguyen, Aditya Joshi +2
Research in emergency triage is restricted to structured electronic health records (EHR) due to regulatory constraints on nurse-patient interactions. We introduce TriageSim, a simu…
Far Out: Evaluating Language Models on Slang in Australian and Indian English
Deniz Kaya Dilsiz, Dipankar Srirag, Aditya Joshi
Language models exhibit systematic performance gaps when processing text in non-standard language varieties, yet their ability to comprehend variety-specific slang remains underexp…
Retell, Reward, Repeat: Reinforcement Learning for Narrative Theory-Informed Story Retelling
David Y. Liu, Xanthe Muston, Dipankar Srirag +2
Counterfactual storytelling exposes LLM shortcomings in causal reasoning, where few-shot prompting and SFT fail to produce logical and rational narratives. This case study introduc…
A Taxonomy-Driven Case Study of Australian Web Resources Against Technology-Facilitated Abuse
Dipankar Srirag, Xiaolin Cen, Rahat Masood +1
Technology-Facilitated Abuse (TFA) encompasses a broad and rapidly evolving set of behaviours in which digital systems are used to harass, monitor, threaten, or control individuals…