A Novel Psychometrics-Based Approach to Developing Professional Competency Benchmark for Large Language Models

Elena Kardanova, Alina Ivanova, Ksenia Tarasova +7

The era of large language models (LLM) raises questions not only about how to train models, but also about how to evaluate them. Despite numerous existing benchmarks, insufficient…