4 papers
IndiCASA: A Dataset and Bias Evaluation Framework in LLMs Using Contrastive Embedding Similarity in the Indian Context
Santhosh G S, Akshay Govind S, Gokul S Krishnan +2
Large Language Models (LLMs) have gained significant traction across critical domains owing to their impressive contextual understanding and generative capabilities. However, their…
mFARM: Towards Multi-Faceted Fairness Assessment based on HARMs in Clinical Decision Support
Shreyash Adappanavar, Krithi Shailya, Gokul S Krishnan +2
The deployment of Large Language Models (LLMs) in high-stakes medical settings poses a critical AI alignment challenge, as models can inherit and amplify societal biases, leading t…
Where Should I Study? Biased Language Models Decide! Evaluating Fairness in LMs for Academic Recommendations
Krithi Shailya, Akhilesh Kumar Mishra, Gokul S Krishnan +1
Large Language Models (LLMs) are increasingly used as daily recommendation systems for tasks like education planning, yet their recommendations risk perpetuating societal biases. T…
LExT: Towards Evaluating Trustworthiness of Natural Language Explanations
Krithi Shailya, Shreya Rajpal, Gokul S Krishnan +1
As Large Language Models (LLMs) become increasingly integrated into high-stakes domains, there have been several approaches proposed toward generating natural language explanations…