6 papers · 1 filter
SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs
Haoran Ou, Gelei Deng, Xuanye Zhang +3
As LLM-based agents perform increasingly complex tasks, Agent Skills have emerged as a flexible mechanism for extending their capabilities. An Agent Skill packages task-specific in…
MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning
Xuanye Zhang, Yongsen Zheng, Zhuqin Xu +5
LLM-driven agents are capable of selecting external tools to complete users' tasks. However, attackers could compromise such process, steering agents toward inappropriate/wrong too…
Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testing
Jiaren Peng, Zeqin Li, Chang You +17
The rapid advancement of Large Language Models (LLMs) has created new opportunities for Automated Penetration Testing (AutoPT), spawning numerous frameworks aimed at achieving end-…
DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systems
Haoran Ou, Kangjie Chen, Gelei Deng +4
Fact-checking systems with search-enabled large language models (LLMs) have shown strong potential for verifying claims by dynamically retrieving external evidence. However, the ro…
When Search Goes Wrong: Red-Teaming Web-Augmented Large Language Models
Haoran Ou, Kangjie Chen, Xingshuo Han +4
Large Language Models (LLMs) have been augmented with web search to overcome the limitations of the static knowledge boundary by accessing up-to-date information from the open Inte…
Oedipus: LLM-enchanced Reasoning CAPTCHA Solver
Gelei Deng, Haoran Ou, Yi Liu +3
CAPTCHAs have become a ubiquitous tool in safeguarding applications from automated bots. Over time, the arms race between CAPTCHA development and evasion techniques has led to incr…