4 papers · 1 filter
Redirected, Not Removed: Task-Dependent Stereotyping Reveals the Limits of LLM Alignments
Divyanshu Kumar, Ishita Gupta, Nitin Aravind Birur +3
How biased is a language model? The answer depends on how you ask. A model that refuses to choose between castes for a leadership role will, in a fill-in-the-blank task, reliably a…
SocioEval: A Template-Based Framework for Evaluating Socioeconomic Status Bias in Foundation Models
Divyanshu Kumar, Ishita Gupta, Nitin Aravind Birur +3
As Large Language Models (LLMs) increasingly power decision-making systems across critical domains, understanding and mitigating their biases becomes essential for responsible AI d…
Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs
Divyanshu Kumar, Umang Jain, Sahil Agarwal +1
Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Re…
VERA: Validation and Enhancement for Retrieval Augmented systems
Nitin Aravind Birur, Tanay Baswa, Divyanshu Kumar +3
Large language models (LLMs) exhibit remarkable capabilities but often produce inaccurate responses, as they rely solely on their embedded knowledge. Retrieval-Augmented Generation…