LLMs taking shortcuts in test generation: A study with SAP HANA and LevelDB

Vekil Bekmyradov, Noah C. Pütz, Thomas Bartz-Beielstein

Large Language Models (LLMs) have achieved impressive results on public benchmarks, often leading to claims of advanced reasoning and understanding. However, recent research in cog…