3 papers
cs.CL2025
ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Prompts
Amelia F. Hardy, Houjun Liu, Allie Griffith +3
Existing LLM red-teaming approaches prioritize high attack success rate, often resulting in high-perplexity prompts. This focus overlooks low-perplexity attacks that are more diffi…
cs.HC2025
LeRAAT: LLM-Enabled Real-Time Aviation Advisory Tool
Marc R. Schlichting, Vale Rasmussen, Heba Alazzeh +5
In aviation emergencies, high-stakes decisions must be made in an instant. Pilots rely on quick access to precise, context-specific information -- an area where emerging tools like…
cs.AI2024
More than Marketing? On the Information Value of AI Benchmarks for Practitioners
Amelia Hardy, Anka Reuel, Kiana Jafari Meimandi +6
Public AI benchmark results are widely broadcast by model developers as indicators of model quality within a growing and competitive market. However, these advertised scores do not…