130 citations · 182 across the 16 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.AI2023
Understanding and Controlling a Maze-Solving Policy Network
Ulisse Mini, Peli Grietzer, Mrinank Sharma +3
To understand the goals and goal representations of AI systems, we carefully study a pretrained reinforcement learning policy that solves mazes by navigating to a range of target s…
cs.CL2023★ 130 cited
Towards Understanding Sycophancy in Language Models
Mrinank Sharma, Meg Tong, Tomasz Korbak +16
Human feedback is commonly utilized to finetune AI assistants. But human feedback may also encourage model responses that match user beliefs over truthful ones, a behaviour known a…