1 citations · 2 across the 7 of their papers we have counts for
8 papers
Understanding Generalization Requires Universal Induction
Aram Ebtekar, Marcus Hutter, Danica J. Sutherland
Classical statistical theory is insufficient to explain the successes of general-purpose AI models, because it depends on handcrafted inductive biases that it cannot justify. No Fr…
Golden Handcuffs make safer AI agents
Aram Ebtekar, Michael K. Cohen
Reinforcement learners can attain high reward through novel unintended strategies. We study a Bayesian mitigation for general environments: we expand the agent's subjective reward…
Recontextualization Mitigates Specification Gaming without Modifying the Specification
Ariana Azarbal, Victor Gillioz, Vladimir Ivanov +6
Developers often struggle to specify correct training labels and rewards. Perhaps they don't need to. We propose recontextualization, which reduces how often language models "game"…
Inoculation Prompting: Instructing LLMs to misbehave at train-time improves test-time alignment
Nevan Wichers, Aram Ebtekar, Ariana Azarbal +8
Large language models are sometimes trained with imperfect oversight signals, leading to undesired behaviors such as reward hacking and sycophancy. Improving oversight quality can…
Toward Universal Laws of Outlier Propagation
Aram Ebtekar, Yuhao Wang, Dominik Janzing
When a variety of anomalous features motivate flagging different samples as outliers, Algorithmic Information Theory (AIT) offers a principled way to unify them in terms of a sampl…
Foundations of algorithmic thermodynamics
Aram Ebtekar, Marcus Hutter
Gács' coarse-grained algorithmic entropy leverages universal computation to quantify the information content of any given physical state. Unlike the Boltzmann and Gibbs-Shannon ent…
Information dynamics and the arrow of time
Aram Ebtekar
Why does time appear to pass irreversibly? To investigate, we introduce a class of partitioned cellular automata (PCAs) whose cellwise evolution is based on the chaotic baker's map…
An Elo-like System for Massive Multiplayer Competitions
Aram Ebtekar, Paul Liu
Rating systems play an important role in competitive sports and games. They provide a measure of player skill, which incentivizes competitive performances and enables balanced matc…