84 citations · 182 across the 24 of their papers we have counts for
5 papers · 2 filters
Beyond Preferences in AI Alignment
Tan Zhi-Xuan, Micah Carroll, Matija Franklin +1
The dominant practice of AI alignment assumes (1) that preferences are an adequate representation of human values, (2) that human rationality can be understood in terms of maximizi…
Infinite Ends from Finite Samples: Open-Ended Goal Inference as Top-Down Bayesian Filtering of Bottom-Up Proposals
Tan Zhi-Xuan, Gloria Kang, Vikash Mansinghka +1
The space of human goals is tremendously vast; and yet, from just a few moments of watching a scene or reading a story, we seem to spontaneously infer a range of plausible motivati…
Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems
David "davidad" Dalrymple, Joar Skalse, Yoshua Bengio +14
Ensuring that AI systems reliably and robustly avoid harmful or dangerous behaviours is a crucial challenge, especially for AI systems with a high degree of autonomy and general in…
Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning
Tan Zhi-Xuan, Lance Ying, Vikash Mansinghka +1
People often give instructions whose meaning is ambiguous without further context, expecting that their actions or goals will disambiguate their intentions. How can we build assist…
Grounding Language about Belief in a Bayesian Theory-of-Mind
Lance Ying, Tan Zhi-Xuan, Lionel Wong +2
Despite the fact that beliefs are mental states that cannot be directly observed, humans talk about each others' beliefs on a regular basis, often using rich compositional language…