54 citations · 181 across the 25 of their papers we have counts for
3 papers · 1 filter
AI Control: Improving Safety Despite Intentional Subversion
Ryan Greenblatt, Buck Shlegeris, Kshitij Sachan +1
As large language models (LLMs) become more powerful and are deployed more autonomously, it will be increasingly important to prevent them from causing harmful outcomes. Researcher…
Generalized Wick Decompositions
Chris MacLeod, Evgenia Nitishinskaya, Buck Shlegeris
We review the cumulant decomposition (a way of decomposing the expectation of a product of random variables (e.g. ) into a sum of terms corresponding to partitions…
Benchmarks for Detecting Measurement Tampering
Fabien Roger, Ryan Greenblatt, Max Nadeau +2
When training powerful AI systems to perform complex tasks, it may be challenging to provide training signals which are robust to optimization. One concern is \textit{measurement t…