activity
20232025
most citedTree of Attacks: Jailbreaking Black-Box LLMs Automatically

24 citations · 24 across the 10 of their papers we have counts for

collaborators

10 papers

cs.LG2025

On Union-Closedness of Language Generation

Steve Hanneke, Amin Karbasi, Anay Mehrotra +1

We investigate language generation in the limit - a model by Kleinberg and Mullainathan [NeurIPS 2024] and extended by Li, Raman, and Tewari [COLT 2025]. While Kleinberg and Mullai…

cs.LG2025

(Im)possibility of Automated Hallucination Detection in Large Language Models

Amin Karbasi, Omar Montasser, John Sous +1

Is automated hallucination detection possible? In this work, we introduce a theoretical framework to analyze the feasibility of automatically detecting hallucinations produced by l…

cs.LG2025

Adversarial Reasoning at Jailbreaking Time

Mahdi Sabbaghi, Paul Kassianik, George Pappas +3

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, mea…

math.OC2024

Criteria and Bias of Parameterized Linear Regression under Edge of Stability Regime

Peiyuan Zhang, Amin Karbasi

Classical optimization theory requires a small step-size for gradient-based methods to converge. Nevertheless, recent findings challenge the traditional idea by empirically demonst…

cs.GT2024

Procurement Auctions via Approximately Optimal Submodular Optimization

Yuan Deng, Amin Karbasi, Vahab Mirrokni +3

We study procurement auctions, where an auctioneer seeks to acquire services from strategic sellers with private costs. The quality of services is measured by a submodular function…

cs.LG2024

Extracting Memorized Training Data via Decomposition

Ellen Su, Anu Vellore, Amy Chang +4

The widespread use of Large Language Models (LLMs) in society creates new information security challenges for developers, organizations, and end-users alike. LLMs are trained on la…

cs.LG2024

Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Models

Alkis Kalavasis, Amin Karbasi, Argyris Oikonomou +3

As ML models become increasingly complex and integral to high-stakes domains such as finance and healthcare, they also become more susceptible to sophisticated adversarial attacks.…

cs.LG2024

On the Computational Landscape of Replicable Learning

Alkis Kalavasis, Amin Karbasi, Grigoris Velegkas +1

We study computational aspects of algorithmic replicability, a notion of stability introduced by Impagliazzo, Lei, Pitassi, and Sorrell [2022]. Motivated by a recent line of work t…

cs.LG2024

Replicable Learning of Large-Margin Halfspaces

Alkis Kalavasis, Amin Karbasi, Kasper Green Larsen +2

We provide efficient replicable algorithms for the problem of learning large-margin halfspaces. Our results improve upon the algorithms provided by Impagliazzo, Lei, Pitassi, and S…

cs.LG2023★ 24 cited

Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Anay Mehrotra, Manolis Zampetakis, Paul Kassianik +4

While Large Language Models (LLMs) display versatile functionality, they continue to generate harmful, biased, and toxic content, as demonstrated by the prevalence of human-designe…