Fundamental Impossibility Results in AI Safety: Trading Off between Desiderata

Ida Mattsson, Ratip Emin Berker, Emanuel Tewolde +11

Is there a fundamental tradeoff between desiderata for safe AI systems, such as harmlessness and helpfulness? We answer by formalizing the interaction between AI systems and users…