132 citations · 273 across the 15 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 16 cited
Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals
Rohin Shah, Vikrant Varma, Ramana Kumar +4
The field of AI alignment is concerned with AI systems that pursue unintended goals. One commonly studied mechanism by which an unintended goal might arise is specification gaming,…
cs.LG2022★ 53 cited
Formal Algorithms for Transformers
Mary Phuong, Marcus Hutter
This document aims to be a self-contained, mathematically precise overview of transformer architectures and algorithms (*not* results). It covers what transformers are, how they ar…