15 citations · 21 across the 15 of their papers we have counts for
7 papers · 1 filter
ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modeling
Zhuohan Wang, Ziwei Zhu, Ziniu Li +8
Formulating optimization problems for industrial applications demands significant manual effort and domain expertise. While Large Language Models (LLMs) show promise in automating…
ChronoPlay: A Framework for Modeling Dual Dynamics and Authenticity in Game RAG Benchmarks
Liyang He, Yuren Zhang, Ziwei Zhu +2
Retrieval Augmented Generation (RAG) systems are increasingly vital in dynamic domains like online gaming, yet the lack of a dedicated benchmark has impeded standardized evaluation…
Bias Association Discovery Framework for Open-Ended LLM Generations
Jinhao Pan, Chahat Raj, Ziwei Zhu
Social biases embedded in Large Language Models (LLMs) raise critical concerns, resulting in representational harms -- unfair or distorted portrayals of demographic groups -- that…
Spurious Correlations and Beyond: Understanding and Mitigating Shortcut Learning in SDOH Extraction with Large Language Models
Fardin Ahsan Sakib, Ziwei Zhu, Karen Trister Grace +2
Social determinants of health (SDOH) extraction from clinical text is critical for downstream healthcare analytics. Although large language models (LLMs) have shown promise, they m…
Talent or Luck? Evaluating Attribution Bias in Large Language Models
Chahat Raj, Mahika Banerjee, Jinhao Pan +3
When a student fails an exam, do we tend to blame their effort or the test's difficulty? Attribution, defined as how reasons are assigned to event outcomes, shapes perceptions, rei…
VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Models
Chahat Raj, Bowen Wei, Aylin Caliskan +2
While bias in large language models (LLMs) is well-studied, similar concerns in vision-language models (VLMs) have received comparatively less attention. Existing VLM bias studies…
Purdah and Patriarchy: Evaluating and Mitigating South Asian Biases in Open-Ended Multilingual LLM Generations
Mamnuya Rinki, Chahat Raj, Anjishnu Mukherjee +1
Evaluations of Large Language Models (LLMs) often overlook intersectional and culturally specific biases, particularly in underrepresented multilingual regions like South Asia. Thi…