Evaluation of large language models using an Indian language LGBTI+ lexicon

Aditya Joshi, Shruta Rawat, Alpana Dange

Large language models (LLMs) are typically evaluated on the basis of task-based benchmarks such as MMLU. Such benchmarks do not examine responsible behaviour of LLMs in specific co…