398 citations · 1.8k across the 163 of their papers we have counts for
174 papers
Language Modeling Is Compression
Grégoire Delétang, Anian Ruoss, Paul-Ambroise Duquenne +9
It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has f…
Line Search for Convex Minimization
Laurent Orseau, Marcus Hutter
Golden-section search and bisection search are the two main principled algorithms for 1d minimization of quasiconvex (unimodal) functions. The first one only uses function queries,…
Combining a Meta-Policy and Monte-Carlo Planning for Scalable Type-Based Reasoning in Partially Observable Environments
Jonathon Schwartz, Hanna Kurniawati, Marcus Hutter
The design of autonomous agents that can interact effectively with other agents without prior coordination is a core problem in multi-agent systems. Type-based reasoning methods ac…
Levin Tree Search with Context Models
Laurent Orseau, Marcus Hutter, Levi H. S. Lelis
Levin Tree Search (LTS) is a search algorithm that makes use of a policy (a probability distribution over actions) and comes with a theoretical guarantee on the number of expansion…
Universal Agent Mixtures and the Geometry of Intelligence
Samuel Allen Alexander, David Quarel, Len Du +1
Inspired by recent progress in multi-agent Reinforcement Learning (RL), in this work we examine the collective intelligent behaviour of theoretical universal agents by introducing…
U-Clip: On-Average Unbiased Stochastic Gradient Clipping
Bryn Elesedy, Marcus Hutter
U-Clip is a simple amendment to gradient clipping that can be applied to any iterative gradient optimization algorithm. Like regular clipping, U-Clip involves using gradients that…