7 citations · 7 across the 4 of their papers we have counts for
4 papers
Value Under Ignorance in Universal Artificial Intelligence
Cole Wyeth, Marcus Hutter
We generalize the AIXI reinforcement learning agent to admit a wider class of utility functions. Assigning a utility to each possible interaction history forces us to confront the…
Formalizing Embeddedness Failures in Universal Artificial Intelligence
Cole Wyeth, Marcus Hutter
We rigorously discuss the commonly asserted failures of the AIXI reinforcement learning agent as a model of embedded agency. We attempt to formalize these failure modes and prove t…
Exponential Speedups by Rerooting Levin Tree Search
Laurent Orseau, Marcus Hutter, Levi H. S. Lelis
Levin Tree Search (LTS) (Orseau et al., 2018) is a search algorithm for deterministic environments that uses a user-specified policy to guide the search. It comes with a formal gua…
Gradient-based Reinforcement Planning in Policy-Search Methods
Ivo Kwee, Marcus Hutter, Juergen Schmidhuber
We introduce a learning method called ``gradient-based reinforcement planning'' (GREP). Unlike traditional DP methods that improve their policy backwards in time, GREP is a gradien…