7 citations · 18 across the 5 of their papers we have counts for
6 papers
SAGE-Eval: Evaluating LLMs for Systematic Generalizations of Safety Facts
Chen Yueh-Han, Guy Davidson, Brenden M. Lake
Do LLMs robustly generalize critical safety facts to novel situations? Lacking this ability is dangerous when users ask naive questions. For instance, "I'm considering packing melo…
Do different prompting methods yield a common task representation in language models?
Guy Davidson, Todd M. Gureckis, Brenden M. Lake +1
Demonstrations and instructions are two primary approaches for prompting language models to perform in-context learning (ICL) tasks. Do identical tasks elicited in different ways r…
Goals as Reward-Producing Programs
Guy Davidson, Graham Todd, Julian Togelius +2
People are remarkably capable of generating their own goals, beginning with child's play and continuing into adulthood. Despite considerable empirical and computational work on goa…
Toward Human-AI Alignment in Large-Scale Multi-Player Games
Sugandha Sharma, Guy Davidson, Khimya Khetarpal +4
Achieving human-AI alignment in complex multi-agent games is crucial for creating trustworthy AI agents that enhance gameplay. We propose a method to evaluate this alignment using…
Investigating Simple Object Representations in Model-Free Deep Reinforcement Learning
Guy Davidson, Brenden M. Lake
We explore the benefits of augmenting state-of-the-art model-free deep reinforcement algorithms with simple object representations. Following the Frostbite challenge posited by Lak…
Sequential mastery of multiple visual tasks: Networks naturally learn to learn and forget to forget
Guy Davidson, Michael C. Mozer
We explore the behavior of a standard convolutional neural net in a continual-learning setting that introduces visual classification tasks sequentially and requires the net to mast…