16 citations · 26 across the 6 of their papers we have counts for
3 papers · 1 filter
Safety from Honesty in a Disinterested AI Predictor
Yoshua Bengio, Oliver Richardson, Tomáš Gavenčiak +13
As AI systems become more capable, training procedures that optimize for downstream outcomes risk introducing implicit agency: goal-directed behavior that designers never specified…
Possible Principles for Aligned Structure Learning Agents
Lancelot Da Costa, Tomáš Gavenčiak, David Hyland +5
This paper offers a roadmap for the development of scalable aligned artificial intelligence (AI) from first principle descriptions of natural intelligence. In brief, a possible pat…
Performance of Bounded-Rational Agents With the Ability to Self-Modify
Jakub Tětek, Marek Sklenka, Tomáš Gavenčiak
Self-modification of agents embedded in complex environments is hard to avoid, whether it happens via direct means (e.g. own code modification) or indirectly (e.g. influencing the…