output
20192026
most citedExtending Environments To Measure Self-Reflection In Reinforcement Learning

12 citations

9 papers

astro-ph.GA2026

Little Red Dots on FIRE: Exploring the formation and observational signatures of ultra-compact early galaxies

Niranjan Chandra Roy, Daniel Anglés-Alcázar, Rachel K. Cochrane +15

Little Red Dots (LRDs) are compact sources with broad Balmer lines, Balmer breaks, anomalous UV emission, rising red continuum, and uncertain origin. We use FIRE cosmological simul…

q-bio.PE2026

Specieslike clusters based on identical ancestor points

Samuel Allen Alexander

We introduce several axioms which may or may not hold for any given subgraph of the directed graph of all organisms (past, present and future) where edges represent biological pare…

math.LO2024

Hyperreal differentiation with an idempotent ultrafilter

Samuel Allen Alexander, Bryan Dawson

In the hyperreals constructed using a free ultrafilter on R, where [f] is the hyperreal represented by f:R->R, it is tempting to define a derivative operator by [f]'=[f'], but unfo…

math.LO2023

Strengthening Consistency Results in Modal Logic

Samuel Allen Alexander, Arthur Paul Pedersen

A fundamental question asked in modal logic is whether a given theory is consistent. But consistent with what? A typical way to address this question identifies a choice of backgro…

cs.AI2021★ 5 cited

Reward-Punishment Symmetric Universal Intelligence

Samuel Allen Alexander, Marcus Hutter

Can an agent's intelligence level be negative? We extend the Legg-Hutter agent-environment framework to include punishments and argue for an affirmative answer to that question. We…

cs.AI2021★ 12 cited

Extending Environments To Measure Self-Reflection In Reinforcement Learning

Samuel Allen Alexander, Michael Castaneda, Kevin Compher +1

We consider an extended notion of reinforcement learning in which the environment can simulate the agent and base its outputs on the agent's hypothetical behavior. Since good perfo…

cs.AI2021★ 1 cited

Measuring Intelligence and Growth Rate: Variations on Hibbard's Intelligence Measure

Samuel Alexander, Bill Hibbard

In 2011, Hibbard suggested an intelligence measure for agents who compete in an adversarial sequence prediction game. We argue that Hibbard's idea should actually be considered as…

cs.LG2020★ 9 cited

The Archimedean trap: Why traditional reinforcement learning will probably not yield AGI

Samuel Allen Alexander

After generalizing the Archimedean property of real numbers in such a way as to make it adaptable to non-numeric structures, we demonstrate that the real numbers cannot be used to…

cs.AI2019★ 5 cited

Intelligence via ultrafilters: structural properties of some intelligence comparators of deterministic Legg-Hutter agents

Samuel Allen Alexander

Legg and Hutter, as well as subsequent authors, considered intelligent agents through the lens of interaction with reward-giving environments, attempting to assign numeric intellig…