3 papers
cs.CL2025
Fairness Dynamics During Training
Krishna Patel, Nivedha Sivakumar, Barry-John Theobald +2
We investigate fairness dynamics during Large Language Model (LLM) training to enable the diagnoses of biases and mitigations through training interventions like early stopping; we…
cs.CL2025
Is Your Model Fairly Certain? Uncertainty-Aware Fairness Evaluation for LLMs
Yinong Oliver Wang, Nivedha Sivakumar, Falaah Arif Khan +6
The recent rapid adoption of large language models (LLMs) highlights the critical need for benchmarking their fairness. Conventional fairness metrics, which focus on discrete accur…
cs.CL2024
Evaluating Gender Bias Transfer between Pre-trained and Prompt-Adapted Language Models
Natalie Mackraz, Nivedha Sivakumar, Samira Khorshidi +4
Large language models (LLMs) are increasingly being adapted to achieve task-specificity for deployment in real-world decision systems. Several previous works have investigated the…