5 papers
Rising From the Ashes: How Agentic AI is Unblocking Challenges in Cybersecurity
Gabriela F. Ciocarlie, Kathrin Grosse, Somesh Jha +3
Security remains a high-cost challenge, with many problems historically deemed inefficient to address or effectively unsolvable. A significant number of these problems stem from la…
Position: Mind the Gap-AI Security and the Limits of Current Reporting Standards
Lukas Bieringer, Sean McGregor, Nicole Nichols +5
AI systems face a growing number of AI security threats that are increasingly exploited in the real world. Hence, shared AI incident reporting practices are emerging in industry as…
Prevalence of Security and Privacy Risk-Inducing Usage of AI-based Conversational Agents
Kathrin Grosse, Nico Ebert
Recent improvement gains in large language models (LLMs) have lead to everyday usage of AI-based Conversational Agents (CAs). At the same time, LLMs are vulnerable to an array of t…
I Stolenly Swear That I Am Up to (No) Good: Design and Evaluation of Model Stealing Attacks
Daryna Oliynyk, Rudolf Mayer, Kathrin Grosse +1
Model stealing attacks endanger the confidentiality of machine learning models offered as a service. Although these models are kept secret, a malicious party can query a model to l…
Design Patterns for Securing LLM Agents against Prompt Injections
Luca Beurer-Kellner, Beat Buesser, Ana-Maria Creţu +11
As AI agents powered by Large Language Models (LLMs) become increasingly versatile and capable of addressing a broad spectrum of tasks, ensuring their security has become a critica…