activity
20192023
most citedOpen Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

95 citations · 124 across the 4 of their papers we have counts for

collaborators
Showing 2021Show all

2 papers · 1 filter

cs.LG2021★ 23 cited

Goal Misgeneralization in Deep Reinforcement Learning

Lauro Langosco, Jack Koch, Lee Sharkey +3

We study goal misgeneralization, a type of out-of-distribution generalization failure in reinforcement learning (RL). Goal misgeneralization failures occur when an RL agent retains…

stat.ML2021★ 2 cited

Robust Semantic Interpretability: Revisiting Concept Activation Vectors

Jacob Pfau, Albert T. Young, Jerome Wei +2

Interpretability methods for image classification assess model trustworthiness by attempting to expose whether the model is systematically biased or attending to the same cues as a…