What's in a Name? Auditing Large Language Models for Race and Gender Bias

Alejandro Salinas, Amit Haim, Julian Nyarko

We employ an audit design to investigate biases in state-of-the-art large language models, including GPT-4. In our study, we prompt the models for advice involving a named individu…