works on
benchmarking 1conflict resolution 1constraint compliance 1instruction hierarchy 1llm robustness 1tool use 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.CR2026

IH-Benchmark: A Conflict-Centered Benchmark for Instruction-Hierarchy Robustness in LLM Applications

Conor McCauley, Zeliang Kan, Jason Martin

The paper introduces IH-Benchmark, a dataset for evaluating how large language models handle conflicting instructions across system‑user and user‑tool hierarchies, using a taxonomy…