24 citations · 84 across the 14 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.AI2019★ 24 cited
Risks from Learned Optimization in Advanced Machine Learning Systems
Evan Hubinger, Chris van Merwijk, Vladimir Mikulik +2
We analyze the type of learned optimization that occurs when a learned model (such as a neural network) is itself an optimizer - a situation we refer to as mesa-optimization, a neo…
cs.AI2019★ 4 cited
Embedded Agency
Abram Demski, Scott Garrabrant
Traditional models of rational action treat the agent as though it is cleanly separated from its environment, and can act on that environment from the outside. Such agents have a k…