4 papers · 1 filter
Bayesian Decision Making around Experts
Daniel Jarne Ornia, Joel Dyer, Nicholas Bishop +2
Complex learning agents are increasingly deployed alongside existing experts, such as human operators or previously trained agents. However, it remains unclear how should learners…
Sandbagging in a Simple Survival Bandit Problem
Joel Dyer, Daniel Jarne Ornia, Nicholas Bishop +2
Evaluating the safety of frontier AI systems is an increasingly important concern, helping to measure the capabilities of such models and identify risks before deployment. However,…
Using causal abstractions to accelerate decision-making in complex bandit problems
Joel Dyer, Nicholas Bishop, Anisoara Calinescu +2
Although real-world decision-making problems can often be encoded as causal multi-armed bandits (CMABs) at different levels of abstraction, a general methodology exploiting the inf…
Causally Abstracted Multi-armed Bandits
Fabio Massimo Zennaro, Nicholas Bishop, Joel Dyer +4
Multi-armed bandits (MAB) and causal MABs (CMAB) are established frameworks for decision-making problems. The majority of prior work typically studies and solves individual MAB and…