Social Bias Evaluation for Large Language Models Requires Prompt Variations

Rem Hida, Masahiro Kaneko, Naoaki Okazaki

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mit…