4 papers
Rethinking Hallucinations: Correctness, Consistency, and Prompt Multiplicity
Prakhar Ganesh, Reza Shokri, Golnoosh Farnadi
Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinforma…
Data as a Lever: A Neighbouring Datasets Perspective on Predictive Multiplicity
Prakhar Ganesh, Hsiang Hsu, Golnoosh Farnadi
Multiplicity, the existence of equally good yet competing models, has received growing attention in recent years. While prior work has emphasized modelling choices, the critical ro…
Say It Another Way: Auditing LLMs with a User-Grounded Automated Paraphrasing Framework
Cléa Chataigner, Rebecca Ma, Prakhar Ganesh +4
Large language models (LLMs) are highly sensitive to subtle changes in prompt phrasing, posing challenges for reliable auditing. Prior methods often apply unconstrained prompt para…
Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learning
Prakhar Ganesh, Afaf Taik, Golnoosh Farnadi
Algorithmic modeling relies on limited information in data to extrapolate outcomes for unseen scenarios, often embedding an element of arbitrariness in its decisions. A perspective…