Towards an Automated Test of LLM Security Knowledge

Shufan Chai, Liangliang Sun, Jessica Staddon

Large language models (LLMs) are increasingly used for a range of software, hardware and human-centered security tasks. Consequently, LLM performance on security tasks is an active…