4 papers
Can You Trust Your Preference Models? Stackelberg Games for Alignment
Riccardo Formenti, Aditya Agrawal, Vikas Garg
Language models are frequently aligned to human preferences via imperfect evaluators whose errors can be exploited during optimization. We train policies to search for comparisons…
Multi-Environment POMDPs: Discrete Model Uncertainty Under Partial Observability
Eline M. Bovy, Caleb Probine, Marnix Suilen +2
Multi-environment POMDPs (ME-POMDPs) extend standard POMDPs with discrete model uncertainty. ME-POMDPs represent a finite set of POMDPs that share the same state, action, and obser…
Robust Markov Decision Processes: A Place Where AI and Formal Methods Meet
Marnix Suilen, Thom Badings, Eline M. Bovy +2
Markov decision processes (MDPs) are a standard model for sequential decision-making problems and are widely used across many scientific areas, including formal methods and artific…
Imprecise Probabilities Meet Partial Observability: Game Semantics for Robust POMDPs
Eline M. Bovy, Marnix Suilen, Sebastian Junges +1
Partially observable Markov decision processes (POMDPs) rely on the key assumption that probability distributions are precisely known. Robust POMDPs (RPOMDPs) alleviate this concer…