Establishing Construct Validity in LLM Capability Benchmarks Requires Nomological Networks

Timo Freiesleben

Recent work in machine learning increasingly attributes human-like capabilities such as reasoning or theory of mind to large language models (LLMs) on the basis of benchmark perfor…