565 citations · 1.1k across the 53 of their papers we have counts for
4 papers · 1 filter
Emergence of Abstract State Representations in Embodied Sequence Modeling
Tian Yun, Zilai Zeng, Kunal Handa +4
Decision making via sequence modeling aims to mimic the success of language models, where actions taken by an embodied agent are modeled as tokens to predict. Despite their promisi…
Instilling Inductive Biases with Subnetworks
Enyan Zhang, Michael A. Lepori, Ellie Pavlick
Despite the recent success of artificial neural networks on a variety of tasks, we have little knowledge or control over the exact solutions these models implement. Instilling indu…
NeuroSurgeon: A Toolkit for Subnetwork Analysis
Michael A. Lepori, Ellie Pavlick, Thomas Serre
Despite recent advances in the field of explainability, much remains unknown about the algorithms that neural networks learn to represent. Recent work has attempted to understand t…
Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs
Kelvin Guu, Albert Webson, Ellie Pavlick +3
Training data attribution (TDA) methods offer to trace a model's prediction on any given example back to specific influential training examples. Existing approaches do so by assign…