activity
20232026
most citedNYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security

3 citations · 6 across the 14 of their papers we have counts for

collaborators
Showing 2025Show all

6 papers · 1 filter

cs.CR2025

Binary Diff Summarization using Large Language Models

Meet Udeshi, Venkata Sai Charan Putrevu, Prashanth Krishnamurthy +4

Security of software supply chains is necessary to ensure that software updates do not contain maliciously injected code or introduce vulnerabilities that may compromise the integr…

cs.CR2025

Ransomware 3.0: Self-Composing and LLM-Orchestrated

Md Raz, Meet Udeshi, P. V. Sai Charan +3

Using automated reasoning, code synthesis, and contextual decision-making, we introduce a new threat that exploits large language models (LLMs) to autonomously plan, adapt, and exe…

cs.CR2025

An Orchestrated Sandbox for Side-Channel Analysis of Cyber-Physical Systems Malware

Meet Udeshi, Venkata Sai Charan Putrevu, Prashanth Krishnamurthy +2

Embedded devices powering cyber-physical systems (CPS) are increasingly internet-exposed, placing critical infrastructure under active threat. Dynamic analysis of embedded malware…

cs.CR2025

Towards Effective Offensive Security LLM Agents: Hyperparameter Tuning, LLM as a Judge, and a Lightweight CTF Benchmark

Minghao Shao, Nanda Rani, Kimberly Milner +9

Recent advances in LLM agentic systems have improved the automation of offensive security tasks, particularly for Capture the Flag (CTF) challenges. We systematically investigate t…

cs.CR2025

CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution

Minghao Shao, Haoran Xi, Nanda Rani +9

Large Language Model (LLM) agents can automate cybersecurity tasks and can adapt to the evolving cybersecurity landscape without re-engineering. While LLM agents have demonstrated…

cs.AI2025★ 1 cited

D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Security

Meet Udeshi, Minghao Shao, Haoran Xi +9

Large Language Models (LLMs) have been used in cybersecurity such as autonomous security analysis or penetration testing. Capture the Flag (CTF) challenges serve as benchmarks to a…