2 papers
cs.SE2024
RMCBench: Benchmarking Large Language Models' Resistance to Malicious Code
Jiachi Chen, Qingyuan Zhong, Yanlin Wang +6
The emergence of Large Language Models (LLMs) has significantly influenced various aspects of software development activities. Despite their benefits, LLMs also pose notable risks,…
cs.CL2024
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay +9
Large Language Model (LLM) leaderboards based on benchmark rankings are regularly used to guide practitioners in model selection. Often, the published leaderboard rankings are take…