16 citations · 26 across the 6 of their papers we have counts for
7 papers
Safety from Honesty in a Disinterested AI Predictor
Yoshua Bengio, Oliver Richardson, Tomáš Gavenčiak +13
As AI systems become more capable, training procedures that optimize for downstream outcomes risk introducing implicit agency: goal-directed behavior that designers never specified…
Multi-Agent Risks from Advanced AI
Lewis Hammond, Alan Chan, Jesse Clifton +41
The rapid development of advanced AI agents and the imminent deployment of many instances of these agents will give rise to multi-agent systems of unprecedented complexity. These s…
Possible Principles for Aligned Structure Learning Agents
Lancelot Da Costa, Tomáš Gavenčiak, David Hyland +5
This paper offers a roadmap for the development of scalable aligned artificial intelligence (AI) from first principle descriptions of natural intelligence. In brief, a possible pat…
Mitigating the Influence of Distractor Tasks in LMs with Prior-Aware Decoding
Raymond Douglas, Andis Draguns, Tomáš Gavenčiak
The broad capabilities of Language Models (LMs) can be limited by their sensitivity to distractor tasks: LMs can infer secondary tasks from the prompt in addition to the intended o…
Performance of Bounded-Rational Agents With the Ability to Self-Modify
Jakub Tětek, Marek Sklenka, Tomáš Gavenčiak
Self-modification of agents embedded in complex environments is hard to avoid, whether it happens via direct means (e.g. own code modification) or indirectly (e.g. influencing the…
How Robust are the Estimated Effects of Nonpharmaceutical Interventions against COVID-19?
Mrinank Sharma, Sören Mindermann, Jan Markus Brauner +7
To what extent are effectiveness estimates of nonpharmaceutical interventions (NPIs) against COVID-19 influenced by the assumptions our models make? To answer this question, we inv…
Compact I/O-Efficient Representation of Separable Graphs and Optimal Tree Layouts
Tomáš Gavenčiak, Jakub Tětek
Compact and I/O-efficient data representations play an important role in efficient algorithm design, as memory bandwidth and latency can present a significant performance bottlenec…