9 papers
From Maturity Models to Ground Truth: Reconciling Cybersecurity Capacity Frameworks with Household-Level Governance Realities in the Global South
Wael Albayaydh, Ivan Flechais
National cybersecurity and digital-governance capacity frameworks, most prominently the Cybersecurity Capacity Maturity Model for Nations (CMM), shape hundreds of millions of dolla…
Regulation, Power, and the Compliance 1 Paradox: A Longitudinal Study of Smart Homes
Wael Albayaydh, Ivan Flechais, Rui Zhao
Smart home technologies are becoming increasingly embedded in domestic environments, yet their implications for power, privacy, and inequality remain insufficiently understood, par…
Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents
Wael Albayaydh, Rui Zhao, Ivan Flechais
Large language model (LLM) agents are increasingly evaluated on their ability to use tools, plan multi-step tasks, coordinate with other agents, and operate over extended horizons.…
The Evaluation Differential: When Frontier AI Models Recognise They Are Being Tested
Varad Vishwarupe, Nigel Shadbolt, Marina Jirotka +1
Recent published evidence from frontier laboratories shows that contemporary AI models can recognise evaluation contexts, latently represent them, and behave differently under thos…
Deployment-Relevant Alignment Cannot Be Inferred from Model-Level Evaluation Alone
Varad Vishwarupe, Nigel Shadbolt, Marina Jirotka +1
Alignment evaluation in machine learning has largely become evaluation of models. Influential benchmarks score model outputs under fixed inputs, such as truthfulness, instruction f…
NeurIPS Should Require Reproducibility Standards for Frontier AI Safety Claims
Varad Vishwarupe, Nigel Shadbolt, Marina Jirotka +1
Frontier AI safety claims - published assertions that a highly capable general-purpose model is below a threshold of concern, adequately mitigated, or suitable for release - increa…
From Rights to Rites: Expectations Management in Smart-Home AI
Varad Vishwarupe, Ivan Flechais, Marina Jirotka +1
Domestic voice assistants and smart-home devices are increasingly embedded in everyday routines, yet their ethics are often treated as an afterthought or delegated to compliance te…
To LLM, or Not to LLM: How Designers and Developers Navigate LLMs as Tools or Teammates
Varad Vishwarupe, Ivan Flechais, Nigel Shadbolt +1
Large language models (LLMs) are increasingly integrated into design and development workflows, yet decisions about their use are rarely binary or purely technical. We report findi…
AI For Privacy in Smart Homes: Exploring How Leveraging AI-Powered Smart Devices Enhances Privacy Protection
Wael Albayaydh, Ivan Flechais, Rui Zhao +1
Privacy concerns and fears of unauthorized access in smart home devices often stem from misunderstandings about how data is collected, used, and protected. This study explores how…